2023-02-13 16:03:21,524 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat timeout: 13 mins 2023-02-13 16:03:21,575 INFO [Time-limited test] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=7, OpenFileDescriptor=240, MaxFileDescriptor=60000, SystemLoadAverage=192, ProcessCount=166, AvailableMemoryMB=2858 2023-02-13 16:03:21,863 DEBUG [Time-limited test] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c 2023-02-13 16:03:21,871 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 16:03:21,871 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/cluster_fb53fa58-d420-547f-422d-aaebeb81b873, deleteOnExit=true 2023-02-13 16:03:21,871 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 16:03:21,872 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/test.cache.data in system properties and HBase conf 2023-02-13 16:03:21,872 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 16:03:21,873 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/hadoop.log.dir in system properties and HBase conf 2023-02-13 16:03:21,873 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 16:03:21,873 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 16:03:21,874 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 16:03:21,989 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-13 16:03:22,390 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 16:03:22,395 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:03:22,395 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:03:22,396 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 16:03:22,396 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:03:22,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 16:03:22,397 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 16:03:22,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:03:22,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:03:22,398 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 16:03:22,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/nfs.dump.dir in system properties and HBase conf 2023-02-13 16:03:22,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/java.io.tmpdir in system properties and HBase conf 2023-02-13 16:03:22,399 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:03:22,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 16:03:22,400 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 16:03:23,009 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:03:23,014 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:03:23,367 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 16:03:23,574 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-13 16:03:23,594 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:23,642 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:23,682 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/java.io.tmpdir/Jetty_localhost_39805_hdfs____.ygntj3/webapp 2023-02-13 16:03:23,829 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39805 2023-02-13 16:03:23,869 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:03:23,870 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:03:24,387 WARN [Listener at localhost/36697] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:24,473 WARN [Listener at localhost/36697] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:03:24,495 WARN [Listener at localhost/36697] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:24,502 INFO [Listener at localhost/36697] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:24,512 INFO [Listener at localhost/36697] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/java.io.tmpdir/Jetty_localhost_42131_datanode____.8r0adk/webapp 2023-02-13 16:03:24,686 INFO [Listener at localhost/36697] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42131 2023-02-13 16:03:25,088 WARN [Listener at localhost/43201] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:25,106 WARN [Listener at localhost/43201] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:03:25,116 WARN [Listener at localhost/43201] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:25,120 INFO [Listener at localhost/43201] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:25,133 INFO [Listener at localhost/43201] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/java.io.tmpdir/Jetty_localhost_35385_datanode____37w9f9/webapp 2023-02-13 16:03:25,279 INFO [Listener at localhost/43201] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35385 2023-02-13 16:03:25,294 WARN [Listener at localhost/36263] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:25,634 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe8c860489d1b66e4: Processing first storage report for DS-80de46df-492a-42c4-9e8d-0aad9112b897 from datanode 8541c6c3-226e-40d4-bb30-76652be545c0 2023-02-13 16:03:25,636 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe8c860489d1b66e4: from storage DS-80de46df-492a-42c4-9e8d-0aad9112b897 node DatanodeRegistration(127.0.0.1:37755, datanodeUuid=8541c6c3-226e-40d4-bb30-76652be545c0, infoPort=34897, infoSecurePort=0, ipcPort=36263, storageInfo=lv=-57;cid=testClusterID;nsid=1546437179;c=1676304203098), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-13 16:03:25,636 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x325fc538ad39a20c: Processing first storage report for DS-98a5aba4-599b-49b5-8c2c-8985450b57cc from datanode b7453fc8-ad9d-4a4f-8eb5-5d292ec6f2a1 2023-02-13 16:03:25,636 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x325fc538ad39a20c: from storage DS-98a5aba4-599b-49b5-8c2c-8985450b57cc node DatanodeRegistration(127.0.0.1:33545, datanodeUuid=b7453fc8-ad9d-4a4f-8eb5-5d292ec6f2a1, infoPort=44745, infoSecurePort=0, ipcPort=43201, storageInfo=lv=-57;cid=testClusterID;nsid=1546437179;c=1676304203098), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:25,636 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe8c860489d1b66e4: Processing first storage report for DS-71168bdb-93c1-4a95-9a8c-10d837b293d6 from datanode 8541c6c3-226e-40d4-bb30-76652be545c0 2023-02-13 16:03:25,636 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe8c860489d1b66e4: from storage DS-71168bdb-93c1-4a95-9a8c-10d837b293d6 node DatanodeRegistration(127.0.0.1:37755, datanodeUuid=8541c6c3-226e-40d4-bb30-76652be545c0, infoPort=34897, infoSecurePort=0, ipcPort=36263, storageInfo=lv=-57;cid=testClusterID;nsid=1546437179;c=1676304203098), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:25,636 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x325fc538ad39a20c: Processing first storage report for DS-dc3f85d3-94a1-479b-be9c-1e5bc08b108c from datanode b7453fc8-ad9d-4a4f-8eb5-5d292ec6f2a1 2023-02-13 16:03:25,636 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x325fc538ad39a20c: from storage DS-dc3f85d3-94a1-479b-be9c-1e5bc08b108c node DatanodeRegistration(127.0.0.1:33545, datanodeUuid=b7453fc8-ad9d-4a4f-8eb5-5d292ec6f2a1, infoPort=44745, infoSecurePort=0, ipcPort=43201, storageInfo=lv=-57;cid=testClusterID;nsid=1546437179;c=1676304203098), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:25,777 DEBUG [Listener at localhost/36263] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c 2023-02-13 16:03:25,893 INFO [Listener at localhost/36263] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/cluster_fb53fa58-d420-547f-422d-aaebeb81b873/zookeeper_0, clientPort=64487, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/cluster_fb53fa58-d420-547f-422d-aaebeb81b873/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/cluster_fb53fa58-d420-547f-422d-aaebeb81b873/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 16:03:25,914 INFO [Listener at localhost/36263] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64487 2023-02-13 16:03:25,926 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:25,929 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:26,596 INFO [Listener at localhost/36263] util.FSUtils(479): Created version file at hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac with version=8 2023-02-13 16:03:26,597 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:26,598 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:26,602 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/hbase-staging 2023-02-13 16:03:26,916 INFO [Listener at localhost/36263] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-13 16:03:27,383 INFO [Listener at localhost/36263] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:27,417 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:27,418 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:27,418 INFO [Listener at localhost/36263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:27,418 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:27,418 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:27,561 INFO [Listener at localhost/36263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:27,637 DEBUG [Listener at localhost/36263] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-13 16:03:27,728 INFO [Listener at localhost/36263] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35105 2023-02-13 16:03:27,739 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:27,741 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:27,767 INFO [Listener at localhost/36263] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35105 connecting to ZooKeeper ensemble=127.0.0.1:64487 2023-02-13 16:03:27,820 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:351050x0, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:27,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35105-0x1004e6c31f30000 connected 2023-02-13 16:03:27,850 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:27,851 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:27,855 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:27,863 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35105 2023-02-13 16:03:27,864 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35105 2023-02-13 16:03:27,868 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35105 2023-02-13 16:03:27,869 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35105 2023-02-13 16:03:27,869 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35105 2023-02-13 16:03:27,875 INFO [Listener at localhost/36263] master.HMaster(439): hbase.rootdir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac, hbase.cluster.distributed=false 2023-02-13 16:03:27,947 INFO [Listener at localhost/36263] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:27,948 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:27,948 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:27,948 INFO [Listener at localhost/36263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:27,948 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:27,948 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:27,953 INFO [Listener at localhost/36263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:27,957 INFO [Listener at localhost/36263] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41173 2023-02-13 16:03:27,959 INFO [Listener at localhost/36263] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:03:27,967 DEBUG [Listener at localhost/36263] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:27,968 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:27,971 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:27,973 INFO [Listener at localhost/36263] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41173 connecting to ZooKeeper ensemble=127.0.0.1:64487 2023-02-13 16:03:27,978 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:411730x0, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:27,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:41173-0x1004e6c31f30001 connected 2023-02-13 16:03:27,979 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:27,980 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:27,981 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:27,982 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41173 2023-02-13 16:03:27,984 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41173 2023-02-13 16:03:27,988 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41173 2023-02-13 16:03:27,988 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41173 2023-02-13 16:03:27,989 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41173 2023-02-13 16:03:28,001 INFO [Listener at localhost/36263] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:28,001 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:28,001 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:28,002 INFO [Listener at localhost/36263] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:28,002 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:28,002 INFO [Listener at localhost/36263] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:28,002 INFO [Listener at localhost/36263] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:28,004 INFO [Listener at localhost/36263] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36967 2023-02-13 16:03:28,005 INFO [Listener at localhost/36263] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:03:28,008 DEBUG [Listener at localhost/36263] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:28,009 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:28,012 INFO [Listener at localhost/36263] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:28,015 INFO [Listener at localhost/36263] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36967 connecting to ZooKeeper ensemble=127.0.0.1:64487 2023-02-13 16:03:28,019 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:369670x0, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:28,020 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:369670x0, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:28,021 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:369670x0, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:28,022 DEBUG [Listener at localhost/36263] zookeeper.ZKUtil(164): regionserver:369670x0, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:28,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36967-0x1004e6c31f30002 connected 2023-02-13 16:03:28,030 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36967 2023-02-13 16:03:28,031 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36967 2023-02-13 16:03:28,031 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36967 2023-02-13 16:03:28,031 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36967 2023-02-13 16:03:28,032 DEBUG [Listener at localhost/36263] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36967 2023-02-13 16:03:28,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35105,1676304206758 2023-02-13 16:03:28,043 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:03:28,044 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35105,1676304206758 2023-02-13 16:03:28,064 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:28,064 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:28,064 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:28,064 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:28,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:03:28,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35105,1676304206758 from backup master directory 2023-02-13 16:03:28,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:03:28,072 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35105,1676304206758 2023-02-13 16:03:28,072 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:03:28,073 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:28,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,35105,1676304206758 2023-02-13 16:03:28,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-13 16:03:28,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-13 16:03:28,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/hbase.id with ID: 92212414-d5e8-412d-a184-d5fd3bcf53e7 2023-02-13 16:03:28,215 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:28,233 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:28,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1c09efab to 127.0.0.1:64487 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:28,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7278e221, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:28,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:28,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 16:03:28,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-13 16:03:28,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-13 16:03:28,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 16:03:28,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-13 16:03:28,365 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:28,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/data/master/store-tmp 2023-02-13 16:03:28,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:28,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:03:28,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:28,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:28,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:03:28,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:28,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:28,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304208435Disabling compacts and flushes for region at 1676304208436 (+1 ms)Disabling writes for close at 1676304208436Writing region close event to WAL at 1676304208436Closed at 1676304208436 2023-02-13 16:03:28,438 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/WALs/jenkins-hbase4.apache.org,35105,1676304206758 2023-02-13 16:03:28,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35105%2C1676304206758, suffix=, logDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/WALs/jenkins-hbase4.apache.org,35105,1676304206758, archiveDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/oldWALs, maxLogs=10 2023-02-13 16:03:28,536 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37755,DS-80de46df-492a-42c4-9e8d-0aad9112b897,DISK] 2023-02-13 16:03:28,536 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33545,DS-98a5aba4-599b-49b5-8c2c-8985450b57cc,DISK] 2023-02-13 16:03:28,544 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-13 16:03:28,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/WALs/jenkins-hbase4.apache.org,35105,1676304206758/jenkins-hbase4.apache.org%2C35105%2C1676304206758.1676304208481 2023-02-13 16:03:28,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37755,DS-80de46df-492a-42c4-9e8d-0aad9112b897,DISK], DatanodeInfoWithStorage[127.0.0.1:33545,DS-98a5aba4-599b-49b5-8c2c-8985450b57cc,DISK]] 2023-02-13 16:03:28,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:28,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:28,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:28,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:28,680 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:28,687 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 16:03:28,716 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 16:03:28,729 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:28,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:28,736 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:28,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:28,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:28,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67841166, jitterRate=0.010912150144577026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:03:28,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676304208649Initializing all the Stores at 1676304208651 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304208652 (+1 ms)Cleaning up temporary data from old regions at 1676304208745 (+93 ms)Cleaning up detritus from prior splits at 1676304208745Region opened successfully at 1676304208763 (+18 ms) 2023-02-13 16:03:28,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 16:03:28,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 16:03:28,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 16:03:28,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 16:03:28,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 16:03:28,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 35 msec 2023-02-13 16:03:28,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 16:03:28,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 16:03:28,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 16:03:28,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 16:03:28,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 16:03:28,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 16:03:28,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 16:03:28,915 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 16:03:28,919 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:28,920 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 16:03:28,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 16:03:28,937 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 16:03:28,943 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:28,943 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:28,943 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:28,943 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:28,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,35105,1676304206758, sessionid=0x1004e6c31f30000, setting cluster-up flag (Was=false) 2023-02-13 16:03:28,965 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:28,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 16:03:28,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35105,1676304206758 2023-02-13 16:03:28,979 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:28,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 16:03:28,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35105,1676304206758 2023-02-13 16:03:28,990 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.hbase-snapshot/.tmp 2023-02-13 16:03:29,036 INFO [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(952): ClusterId : 92212414-d5e8-412d-a184-d5fd3bcf53e7 2023-02-13 16:03:29,036 INFO [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(952): ClusterId : 92212414-d5e8-412d-a184-d5fd3bcf53e7 2023-02-13 16:03:29,042 DEBUG [RS:0;jenkins-hbase4:41173] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:03:29,042 DEBUG [RS:1;jenkins-hbase4:36967] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:03:29,050 DEBUG [RS:1;jenkins-hbase4:36967] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:03:29,050 DEBUG [RS:1;jenkins-hbase4:36967] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:03:29,050 DEBUG [RS:0;jenkins-hbase4:41173] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:03:29,051 DEBUG [RS:0;jenkins-hbase4:41173] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:03:29,054 DEBUG [RS:1;jenkins-hbase4:36967] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:03:29,054 DEBUG [RS:0;jenkins-hbase4:41173] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:03:29,056 DEBUG [RS:1;jenkins-hbase4:36967] zookeeper.ReadOnlyZKClient(139): Connect 0x75ac29fc to 127.0.0.1:64487 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:29,057 DEBUG [RS:0;jenkins-hbase4:41173] zookeeper.ReadOnlyZKClient(139): Connect 0x37687ebc to 127.0.0.1:64487 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:29,079 DEBUG [RS:0;jenkins-hbase4:41173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39af8621, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:29,080 DEBUG [RS:1;jenkins-hbase4:36967] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b6bd939, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:29,080 DEBUG [RS:0;jenkins-hbase4:41173] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d9015cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:29,080 DEBUG [RS:1;jenkins-hbase4:36967] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f54428c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:29,112 DEBUG [RS:1;jenkins-hbase4:36967] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36967 2023-02-13 16:03:29,114 DEBUG [RS:0;jenkins-hbase4:41173] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41173 2023-02-13 16:03:29,117 INFO [RS:1;jenkins-hbase4:36967] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:03:29,118 INFO [RS:1;jenkins-hbase4:36967] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:03:29,117 INFO [RS:0;jenkins-hbase4:41173] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:03:29,118 DEBUG [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:03:29,118 INFO [RS:0;jenkins-hbase4:41173] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:03:29,118 DEBUG [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:03:29,121 INFO [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35105,1676304206758 with isa=jenkins-hbase4.apache.org/172.31.14.131:36967, startcode=1676304208000 2023-02-13 16:03:29,121 INFO [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35105,1676304206758 with isa=jenkins-hbase4.apache.org/172.31.14.131:41173, startcode=1676304207946 2023-02-13 16:03:29,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:29,141 DEBUG [RS:0;jenkins-hbase4:41173] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:03:29,141 DEBUG [RS:1;jenkins-hbase4:36967] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:03:29,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:29,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:29,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:29,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:29,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 16:03:29,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:29,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676304239155 2023-02-13 16:03:29,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 16:03:29,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 16:03:29,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 16:03:29,182 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:29,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 16:03:29,183 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 16:03:29,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 16:03:29,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 16:03:29,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 16:03:29,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 16:03:29,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 16:03:29,188 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:29,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 16:03:29,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 16:03:29,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304209196,5,FailOnTimeoutGroup] 2023-02-13 16:03:29,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304209196,5,FailOnTimeoutGroup] 2023-02-13 16:03:29,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 16:03:29,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,203 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44287, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:03:29,203 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41403, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:03:29,214 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35105] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:29,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:29,249 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:29,249 DEBUG [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac 2023-02-13 16:03:29,250 DEBUG [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac 2023-02-13 16:03:29,250 DEBUG [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36697 2023-02-13 16:03:29,250 DEBUG [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36697 2023-02-13 16:03:29,250 DEBUG [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:03:29,250 DEBUG [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:03:29,251 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:29,251 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac 2023-02-13 16:03:29,257 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:29,262 DEBUG [RS:0;jenkins-hbase4:41173] zookeeper.ZKUtil(162): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:29,262 WARN [RS:0;jenkins-hbase4:41173] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:29,263 INFO [RS:0;jenkins-hbase4:41173] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:29,264 DEBUG [RS:1;jenkins-hbase4:36967] zookeeper.ZKUtil(162): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:29,264 WARN [RS:1;jenkins-hbase4:36967] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:29,264 INFO [RS:1;jenkins-hbase4:36967] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:29,265 DEBUG [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/WALs/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:29,264 DEBUG [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/WALs/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:29,264 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41173,1676304207946] 2023-02-13 16:03:29,267 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36967,1676304208000] 2023-02-13 16:03:29,280 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:29,282 DEBUG [RS:0;jenkins-hbase4:41173] zookeeper.ZKUtil(162): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:29,282 DEBUG [RS:1;jenkins-hbase4:36967] zookeeper.ZKUtil(162): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:29,283 DEBUG [RS:0;jenkins-hbase4:41173] zookeeper.ZKUtil(162): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:29,283 DEBUG [RS:1;jenkins-hbase4:36967] zookeeper.ZKUtil(162): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:29,285 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:03:29,288 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/info 2023-02-13 16:03:29,289 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:03:29,290 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:29,290 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:03:29,293 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:29,294 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:03:29,294 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:29,295 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:03:29,297 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/table 2023-02-13 16:03:29,298 DEBUG [RS:0;jenkins-hbase4:41173] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:03:29,298 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:03:29,298 DEBUG [RS:1;jenkins-hbase4:36967] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:03:29,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:29,302 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740 2023-02-13 16:03:29,302 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740 2023-02-13 16:03:29,308 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:03:29,310 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:03:29,311 INFO [RS:0;jenkins-hbase4:41173] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:03:29,311 INFO [RS:1;jenkins-hbase4:36967] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:03:29,316 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:29,317 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65110864, jitterRate=-0.029772520065307617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:03:29,317 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676304209280Initializing all the Stores at 1676304209282 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304209284 (+2 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304209284Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304209284Cleaning up temporary data from old regions at 1676304209305 (+21 ms)Cleaning up detritus from prior splits at 1676304209306 (+1 ms)Region opened successfully at 1676304209317 (+11 ms) 2023-02-13 16:03:29,317 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:03:29,317 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:03:29,317 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:03:29,317 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:03:29,317 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:03:29,318 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:03:29,319 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304209317Disabling compacts and flushes for region at 1676304209317Disabling writes for close at 1676304209317Writing region close event to WAL at 1676304209318 (+1 ms)Closed at 1676304209318 2023-02-13 16:03:29,326 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:29,326 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 16:03:29,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 16:03:29,340 INFO [RS:1;jenkins-hbase4:36967] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:03:29,341 INFO [RS:0;jenkins-hbase4:41173] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:03:29,350 INFO [RS:0;jenkins-hbase4:41173] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:03:29,350 INFO [RS:0;jenkins-hbase4:41173] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,351 INFO [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:03:29,350 INFO [RS:1;jenkins-hbase4:36967] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:03:29,352 INFO [RS:1;jenkins-hbase4:36967] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,354 INFO [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:03:29,355 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 16:03:29,358 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 16:03:29,364 INFO [RS:0;jenkins-hbase4:41173] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,364 INFO [RS:1;jenkins-hbase4:36967] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,365 DEBUG [RS:0;jenkins-hbase4:41173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,365 DEBUG [RS:1;jenkins-hbase4:36967] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,365 DEBUG [RS:0;jenkins-hbase4:41173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,365 DEBUG [RS:1;jenkins-hbase4:36967] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,365 DEBUG [RS:0;jenkins-hbase4:41173] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,365 DEBUG [RS:1;jenkins-hbase4:36967] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,365 DEBUG [RS:0;jenkins-hbase4:41173] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,365 DEBUG [RS:1;jenkins-hbase4:36967] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,366 DEBUG [RS:0;jenkins-hbase4:41173] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,366 DEBUG [RS:1;jenkins-hbase4:36967] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,366 DEBUG [RS:0;jenkins-hbase4:41173] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:29,366 DEBUG [RS:1;jenkins-hbase4:36967] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:29,366 DEBUG [RS:0;jenkins-hbase4:41173] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,366 DEBUG [RS:1;jenkins-hbase4:36967] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,366 DEBUG [RS:0;jenkins-hbase4:41173] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,366 DEBUG [RS:1;jenkins-hbase4:36967] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,367 DEBUG [RS:0;jenkins-hbase4:41173] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,367 DEBUG [RS:1;jenkins-hbase4:36967] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,367 DEBUG [RS:0;jenkins-hbase4:41173] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,367 DEBUG [RS:1;jenkins-hbase4:36967] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:29,371 INFO [RS:1;jenkins-hbase4:36967] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,371 INFO [RS:1;jenkins-hbase4:36967] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,372 INFO [RS:1;jenkins-hbase4:36967] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,372 INFO [RS:0;jenkins-hbase4:41173] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,372 INFO [RS:0;jenkins-hbase4:41173] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,372 INFO [RS:0;jenkins-hbase4:41173] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,391 INFO [RS:1;jenkins-hbase4:36967] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:03:29,391 INFO [RS:0;jenkins-hbase4:41173] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:03:29,396 INFO [RS:0;jenkins-hbase4:41173] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41173,1676304207946-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,396 INFO [RS:1;jenkins-hbase4:36967] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36967,1676304208000-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,422 INFO [RS:1;jenkins-hbase4:36967] regionserver.Replication(203): jenkins-hbase4.apache.org,36967,1676304208000 started 2023-02-13 16:03:29,422 INFO [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36967,1676304208000, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36967, sessionid=0x1004e6c31f30002 2023-02-13 16:03:29,422 DEBUG [RS:1;jenkins-hbase4:36967] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:03:29,423 INFO [RS:0;jenkins-hbase4:41173] regionserver.Replication(203): jenkins-hbase4.apache.org,41173,1676304207946 started 2023-02-13 16:03:29,423 DEBUG [RS:1;jenkins-hbase4:36967] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:29,423 INFO [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,41173,1676304207946, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41173, sessionid=0x1004e6c31f30001 2023-02-13 16:03:29,423 DEBUG [RS:1;jenkins-hbase4:36967] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36967,1676304208000' 2023-02-13 16:03:29,423 DEBUG [RS:0;jenkins-hbase4:41173] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:03:29,423 DEBUG [RS:1;jenkins-hbase4:36967] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:29,423 DEBUG [RS:0;jenkins-hbase4:41173] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:29,424 DEBUG [RS:0;jenkins-hbase4:41173] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41173,1676304207946' 2023-02-13 16:03:29,424 DEBUG [RS:0;jenkins-hbase4:41173] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:29,425 DEBUG [RS:1;jenkins-hbase4:36967] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:29,425 DEBUG [RS:0;jenkins-hbase4:41173] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:29,426 DEBUG [RS:1;jenkins-hbase4:36967] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:03:29,426 DEBUG [RS:1;jenkins-hbase4:36967] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:03:29,426 DEBUG [RS:1;jenkins-hbase4:36967] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:29,426 DEBUG [RS:1;jenkins-hbase4:36967] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36967,1676304208000' 2023-02-13 16:03:29,426 DEBUG [RS:0;jenkins-hbase4:41173] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:03:29,426 DEBUG [RS:0;jenkins-hbase4:41173] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:03:29,426 DEBUG [RS:1;jenkins-hbase4:36967] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:29,426 DEBUG [RS:0;jenkins-hbase4:41173] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:29,427 DEBUG [RS:0;jenkins-hbase4:41173] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41173,1676304207946' 2023-02-13 16:03:29,427 DEBUG [RS:0;jenkins-hbase4:41173] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:29,427 DEBUG [RS:0;jenkins-hbase4:41173] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:29,428 DEBUG [RS:1;jenkins-hbase4:36967] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:29,428 DEBUG [RS:0;jenkins-hbase4:41173] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:03:29,428 INFO [RS:0;jenkins-hbase4:41173] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:03:29,428 INFO [RS:0;jenkins-hbase4:41173] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:03:29,428 DEBUG [RS:1;jenkins-hbase4:36967] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:03:29,428 INFO [RS:1;jenkins-hbase4:36967] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:03:29,429 INFO [RS:1;jenkins-hbase4:36967] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:03:29,510 DEBUG [jenkins-hbase4:35105] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 16:03:29,515 DEBUG [jenkins-hbase4:35105] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:29,521 DEBUG [jenkins-hbase4:35105] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:29,521 DEBUG [jenkins-hbase4:35105] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:29,521 DEBUG [jenkins-hbase4:35105] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:29,524 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36967,1676304208000, state=OPENING 2023-02-13 16:03:29,533 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 16:03:29,535 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:29,535 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:03:29,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:29,727 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:29,729 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:03:29,732 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35038, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:03:29,744 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 16:03:29,745 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:29,748 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36967%2C1676304208000.meta, suffix=.meta, logDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/WALs/jenkins-hbase4.apache.org,36967,1676304208000, archiveDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/oldWALs, maxLogs=32 2023-02-13 16:03:29,773 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33545,DS-98a5aba4-599b-49b5-8c2c-8985450b57cc,DISK] 2023-02-13 16:03:29,773 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37755,DS-80de46df-492a-42c4-9e8d-0aad9112b897,DISK] 2023-02-13 16:03:29,778 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/WALs/jenkins-hbase4.apache.org,36967,1676304208000/jenkins-hbase4.apache.org%2C36967%2C1676304208000.meta.1676304209753.meta 2023-02-13 16:03:29,778 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37755,DS-80de46df-492a-42c4-9e8d-0aad9112b897,DISK], DatanodeInfoWithStorage[127.0.0.1:33545,DS-98a5aba4-599b-49b5-8c2c-8985450b57cc,DISK]] 2023-02-13 16:03:29,778 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:29,780 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 16:03:29,797 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 16:03:29,803 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 16:03:29,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 16:03:29,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:29,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 16:03:29,808 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 16:03:29,811 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:03:29,813 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/info 2023-02-13 16:03:29,814 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/info 2023-02-13 16:03:29,814 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:03:29,815 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:29,816 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:03:29,817 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:29,817 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:29,818 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:03:29,818 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:29,819 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:03:29,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/table 2023-02-13 16:03:29,820 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/table 2023-02-13 16:03:29,820 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:03:29,821 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:29,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740 2023-02-13 16:03:29,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740 2023-02-13 16:03:29,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:03:29,832 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:03:29,834 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71593595, jitterRate=0.0668276995420456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:03:29,834 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676304209809Writing region info on filesystem at 1676304209809Initializing all the Stores at 1676304209810 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304209811 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304209811Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304209811Cleaning up temporary data from old regions at 1676304209828 (+17 ms)Cleaning up detritus from prior splits at 1676304209828Running coprocessor post-open hooks at 1676304209834 (+6 ms)Region opened successfully at 1676304209834 2023-02-13 16:03:29,844 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676304209719 2023-02-13 16:03:29,862 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 16:03:29,863 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 16:03:29,863 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36967,1676304208000, state=OPEN 2023-02-13 16:03:29,866 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 16:03:29,866 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:03:29,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 16:03:29,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36967,1676304208000 in 327 msec 2023-02-13 16:03:29,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 16:03:29,875 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 535 msec 2023-02-13 16:03:29,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 824 msec 2023-02-13 16:03:29,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676304208060, completionTime=-1 2023-02-13 16:03:29,881 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 16:03:29,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 16:03:29,949 DEBUG [hconnection-0x520f2553-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:29,952 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:29,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 16:03:29,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676304269969 2023-02-13 16:03:29,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676304329970 2023-02-13 16:03:29,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 88 msec 2023-02-13 16:03:29,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35105,1676304206758-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35105,1676304206758-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35105,1676304206758-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35105, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:29,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:30,004 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 16:03:30,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 16:03:30,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:30,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 16:03:30,027 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:03:30,030 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:03:30,051 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:30,053 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5 empty. 2023-02-13 16:03:30,054 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:30,054 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 16:03:30,080 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:30,083 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => c773071ee94ece081aa8d20501a777c5, NAME => 'hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:30,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:30,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing c773071ee94ece081aa8d20501a777c5, disabling compactions & flushes 2023-02-13 16:03:30,107 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:30,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:30,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. after waiting 0 ms 2023-02-13 16:03:30,107 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:30,107 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:30,108 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for c773071ee94ece081aa8d20501a777c5: Waiting for close lock at 1676304210107Disabling compacts and flushes for region at 1676304210107Disabling writes for close at 1676304210107Writing region close event to WAL at 1676304210107Closed at 1676304210107 2023-02-13 16:03:30,113 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:03:30,128 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304210116"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304210116"}]},"ts":"1676304210116"} 2023-02-13 16:03:30,156 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:03:30,158 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:03:30,163 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304210158"}]},"ts":"1676304210158"} 2023-02-13 16:03:30,168 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 16:03:30,172 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:30,174 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:30,175 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:30,175 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:30,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c773071ee94ece081aa8d20501a777c5, ASSIGN}] 2023-02-13 16:03:30,180 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c773071ee94ece081aa8d20501a777c5, ASSIGN 2023-02-13 16:03:30,182 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c773071ee94ece081aa8d20501a777c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41173,1676304207946; forceNewPlan=false, retain=false 2023-02-13 16:03:30,335 INFO [jenkins-hbase4:35105] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:03:30,336 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c773071ee94ece081aa8d20501a777c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:30,337 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304210336"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304210336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304210336"}]},"ts":"1676304210336"} 2023-02-13 16:03:30,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c773071ee94ece081aa8d20501a777c5, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:30,439 INFO [RS:0;jenkins-hbase4:41173] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41173%2C1676304207946, suffix=, logDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/WALs/jenkins-hbase4.apache.org,41173,1676304207946, archiveDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/oldWALs, maxLogs=32 2023-02-13 16:03:30,439 INFO [RS:1;jenkins-hbase4:36967] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36967%2C1676304208000, suffix=, logDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/WALs/jenkins-hbase4.apache.org,36967,1676304208000, archiveDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/oldWALs, maxLogs=32 2023-02-13 16:03:30,461 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33545,DS-98a5aba4-599b-49b5-8c2c-8985450b57cc,DISK] 2023-02-13 16:03:30,462 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33545,DS-98a5aba4-599b-49b5-8c2c-8985450b57cc,DISK] 2023-02-13 16:03:30,463 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37755,DS-80de46df-492a-42c4-9e8d-0aad9112b897,DISK] 2023-02-13 16:03:30,463 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37755,DS-80de46df-492a-42c4-9e8d-0aad9112b897,DISK] 2023-02-13 16:03:30,469 INFO [RS:1;jenkins-hbase4:36967] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/WALs/jenkins-hbase4.apache.org,36967,1676304208000/jenkins-hbase4.apache.org%2C36967%2C1676304208000.1676304210442 2023-02-13 16:03:30,469 INFO [RS:0;jenkins-hbase4:41173] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/WALs/jenkins-hbase4.apache.org,41173,1676304207946/jenkins-hbase4.apache.org%2C41173%2C1676304207946.1676304210442 2023-02-13 16:03:30,469 DEBUG [RS:1;jenkins-hbase4:36967] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33545,DS-98a5aba4-599b-49b5-8c2c-8985450b57cc,DISK], DatanodeInfoWithStorage[127.0.0.1:37755,DS-80de46df-492a-42c4-9e8d-0aad9112b897,DISK]] 2023-02-13 16:03:30,469 DEBUG [RS:0;jenkins-hbase4:41173] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33545,DS-98a5aba4-599b-49b5-8c2c-8985450b57cc,DISK], DatanodeInfoWithStorage[127.0.0.1:37755,DS-80de46df-492a-42c4-9e8d-0aad9112b897,DISK]] 2023-02-13 16:03:30,507 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:30,508 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:03:30,514 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38414, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:03:30,521 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:30,522 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c773071ee94ece081aa8d20501a777c5, NAME => 'hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:30,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:30,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:30,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:30,523 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:30,526 INFO [StoreOpener-c773071ee94ece081aa8d20501a777c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:30,528 DEBUG [StoreOpener-c773071ee94ece081aa8d20501a777c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5/info 2023-02-13 16:03:30,528 DEBUG [StoreOpener-c773071ee94ece081aa8d20501a777c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5/info 2023-02-13 16:03:30,529 INFO [StoreOpener-c773071ee94ece081aa8d20501a777c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c773071ee94ece081aa8d20501a777c5 columnFamilyName info 2023-02-13 16:03:30,530 INFO [StoreOpener-c773071ee94ece081aa8d20501a777c5-1] regionserver.HStore(310): Store=c773071ee94ece081aa8d20501a777c5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:30,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:30,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:30,537 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:30,541 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:30,542 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened c773071ee94ece081aa8d20501a777c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67127296, jitterRate=2.74658203125E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:03:30,542 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for c773071ee94ece081aa8d20501a777c5: Running coprocessor pre-open hook at 1676304210523Writing region info on filesystem at 1676304210523Initializing all the Stores at 1676304210525 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304210525Cleaning up temporary data from old regions at 1676304210533 (+8 ms)Cleaning up detritus from prior splits at 1676304210533Running coprocessor post-open hooks at 1676304210542 (+9 ms)Region opened successfully at 1676304210542 2023-02-13 16:03:30,544 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5., pid=6, masterSystemTime=1676304210507 2023-02-13 16:03:30,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:30,549 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:30,550 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c773071ee94ece081aa8d20501a777c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:30,551 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304210550"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304210550"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304210550"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304210550"}]},"ts":"1676304210550"} 2023-02-13 16:03:30,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 16:03:30,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c773071ee94ece081aa8d20501a777c5, server=jenkins-hbase4.apache.org,41173,1676304207946 in 211 msec 2023-02-13 16:03:30,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 16:03:30,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c773071ee94ece081aa8d20501a777c5, ASSIGN in 383 msec 2023-02-13 16:03:30,565 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:03:30,565 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304210565"}]},"ts":"1676304210565"} 2023-02-13 16:03:30,568 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 16:03:30,572 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:03:30,575 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 556 msec 2023-02-13 16:03:30,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 16:03:30,629 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:30,630 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:30,652 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:30,655 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:30,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 16:03:30,686 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:30,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2023-02-13 16:03:30,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 16:03:30,715 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:30,721 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-02-13 16:03:30,729 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 16:03:30,732 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 16:03:30,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 2.659sec 2023-02-13 16:03:30,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 16:03:30,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 16:03:30,738 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 16:03:30,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35105,1676304206758-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 16:03:30,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35105,1676304206758-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 16:03:30,743 DEBUG [Listener at localhost/36263] zookeeper.ReadOnlyZKClient(139): Connect 0x4849a610 to 127.0.0.1:64487 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:30,748 DEBUG [Listener at localhost/36263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10bd3f60, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:30,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 16:03:30,782 DEBUG [hconnection-0xed0c6d0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:30,793 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35054, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:30,803 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35105,1676304206758 2023-02-13 16:03:30,804 DEBUG [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 16:03:30,812 DEBUG [Listener at localhost/36263] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 16:03:30,815 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42624, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 16:03:30,820 INFO [Listener at localhost/36263] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 16:03:30,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 16:03:30,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 16:03:30,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:42624 deadline: 1676304270823, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 16:03:30,843 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 16:03:30,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:30,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 16:03:30,862 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:03:30,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:03:30,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 16:03:30,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:30,886 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:30,886 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:30,886 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:30,886 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:30,886 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:30,887 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da empty. 2023-02-13 16:03:30,886 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:30,887 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1 empty. 2023-02-13 16:03:30,886 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:30,886 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:30,887 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac empty. 2023-02-13 16:03:30,889 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159 empty. 2023-02-13 16:03:30,889 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:30,889 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:30,889 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe empty. 2023-02-13 16:03:30,890 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199 empty. 2023-02-13 16:03:30,890 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab empty. 2023-02-13 16:03:30,890 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:30,890 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:30,890 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420 empty. 2023-02-13 16:03:30,890 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:30,891 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:30,891 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf empty. 2023-02-13 16:03:30,891 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f empty. 2023-02-13 16:03:30,891 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:30,891 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:30,891 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:30,891 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:30,892 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:30,892 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:30,892 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 16:03:30,911 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:30,914 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => e1cc34bf8ae0ff6d80f568e3df8d51ac, NAME => 'testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:30,914 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => f771c0f84d5513cee8c74cb9a669f3da, NAME => 'testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:30,914 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 08b03f0c40004487390286d5ac7bc159, NAME => 'testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:30,956 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:30,957 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing e1cc34bf8ae0ff6d80f568e3df8d51ac, disabling compactions & flushes 2023-02-13 16:03:30,957 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:30,957 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:30,957 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. after waiting 0 ms 2023-02-13 16:03:30,957 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:30,957 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:30,957 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for e1cc34bf8ae0ff6d80f568e3df8d51ac: Waiting for close lock at 1676304210957Disabling compacts and flushes for region at 1676304210957Disabling writes for close at 1676304210957Writing region close event to WAL at 1676304210957Closed at 1676304210957 2023-02-13 16:03:30,958 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => bf321661089a71e880fa4506d4b440a1, NAME => 'testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:30,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:30,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing f771c0f84d5513cee8c74cb9a669f3da, disabling compactions & flushes 2023-02-13 16:03:30,959 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:30,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:30,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. after waiting 0 ms 2023-02-13 16:03:30,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:30,959 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:30,959 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for f771c0f84d5513cee8c74cb9a669f3da: Waiting for close lock at 1676304210959Disabling compacts and flushes for region at 1676304210959Disabling writes for close at 1676304210959Writing region close event to WAL at 1676304210959Closed at 1676304210959 2023-02-13 16:03:30,960 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b6ef70859660c5e71ec250c64943bdab, NAME => 'testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:30,965 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:30,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 08b03f0c40004487390286d5ac7bc159, disabling compactions & flushes 2023-02-13 16:03:30,967 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:30,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:30,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. after waiting 0 ms 2023-02-13 16:03:30,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:30,967 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:30,967 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 08b03f0c40004487390286d5ac7bc159: Waiting for close lock at 1676304210967Disabling compacts and flushes for region at 1676304210967Disabling writes for close at 1676304210967Writing region close event to WAL at 1676304210967Closed at 1676304210967 2023-02-13 16:03:30,968 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 7e2fac213f0894558e0b6e83b1bc8199, NAME => 'testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:30,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:31,014 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,014 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing bf321661089a71e880fa4506d4b440a1, disabling compactions & flushes 2023-02-13 16:03:31,014 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:31,014 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:31,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. after waiting 0 ms 2023-02-13 16:03:31,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:31,015 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:31,015 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for bf321661089a71e880fa4506d4b440a1: Waiting for close lock at 1676304211014Disabling compacts and flushes for region at 1676304211014Disabling writes for close at 1676304211015 (+1 ms)Writing region close event to WAL at 1676304211015Closed at 1676304211015 2023-02-13 16:03:31,016 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 7d3679b4d7608731a817f64e86875cfe, NAME => 'testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:31,023 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,023 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b6ef70859660c5e71ec250c64943bdab, disabling compactions & flushes 2023-02-13 16:03:31,023 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:31,023 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:31,023 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. after waiting 0 ms 2023-02-13 16:03:31,023 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:31,023 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:31,023 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b6ef70859660c5e71ec250c64943bdab: Waiting for close lock at 1676304211023Disabling compacts and flushes for region at 1676304211023Disabling writes for close at 1676304211023Writing region close event to WAL at 1676304211023Closed at 1676304211023 2023-02-13 16:03:31,023 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 74aaf39c3cb3d5ead7b8147b9fc28eaf, NAME => 'testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:31,042 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,044 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 7e2fac213f0894558e0b6e83b1bc8199, disabling compactions & flushes 2023-02-13 16:03:31,044 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:31,044 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:31,044 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. after waiting 0 ms 2023-02-13 16:03:31,044 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:31,044 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:31,046 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 7e2fac213f0894558e0b6e83b1bc8199: Waiting for close lock at 1676304211044Disabling compacts and flushes for region at 1676304211044Disabling writes for close at 1676304211044Writing region close event to WAL at 1676304211044Closed at 1676304211044 2023-02-13 16:03:31,047 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 15f5c1365441d7442a60654e2caee420, NAME => 'testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:31,074 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,075 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 7d3679b4d7608731a817f64e86875cfe, disabling compactions & flushes 2023-02-13 16:03:31,075 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:31,075 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:31,075 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. after waiting 0 ms 2023-02-13 16:03:31,075 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:31,075 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:31,075 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 7d3679b4d7608731a817f64e86875cfe: Waiting for close lock at 1676304211075Disabling compacts and flushes for region at 1676304211075Disabling writes for close at 1676304211075Writing region close event to WAL at 1676304211075Closed at 1676304211075 2023-02-13 16:03:31,076 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => cb76a17f03c6763538343ae979580d3f, NAME => 'testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp 2023-02-13 16:03:31,081 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 74aaf39c3cb3d5ead7b8147b9fc28eaf, disabling compactions & flushes 2023-02-13 16:03:31,082 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:31,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:31,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. after waiting 0 ms 2023-02-13 16:03:31,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:31,082 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:31,082 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 74aaf39c3cb3d5ead7b8147b9fc28eaf: Waiting for close lock at 1676304211082Disabling compacts and flushes for region at 1676304211082Disabling writes for close at 1676304211082Writing region close event to WAL at 1676304211082Closed at 1676304211082 2023-02-13 16:03:31,104 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,104 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 15f5c1365441d7442a60654e2caee420, disabling compactions & flushes 2023-02-13 16:03:31,105 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:31,105 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:31,105 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. after waiting 0 ms 2023-02-13 16:03:31,105 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:31,105 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:31,105 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 15f5c1365441d7442a60654e2caee420: Waiting for close lock at 1676304211104Disabling compacts and flushes for region at 1676304211104Disabling writes for close at 1676304211105 (+1 ms)Writing region close event to WAL at 1676304211105Closed at 1676304211105 2023-02-13 16:03:31,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing cb76a17f03c6763538343ae979580d3f, disabling compactions & flushes 2023-02-13 16:03:31,115 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:31,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:31,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. after waiting 0 ms 2023-02-13 16:03:31,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:31,115 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:31,115 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for cb76a17f03c6763538343ae979580d3f: Waiting for close lock at 1676304211115Disabling compacts and flushes for region at 1676304211115Disabling writes for close at 1676304211115Writing region close event to WAL at 1676304211115Closed at 1676304211115 2023-02-13 16:03:31,121 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:03:31,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304211122"}]},"ts":"1676304211122"} 2023-02-13 16:03:31,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304211122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304211122"}]},"ts":"1676304211122"} 2023-02-13 16:03:31,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304211122"}]},"ts":"1676304211122"} 2023-02-13 16:03:31,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304211122"}]},"ts":"1676304211122"} 2023-02-13 16:03:31,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304211122"}]},"ts":"1676304211122"} 2023-02-13 16:03:31,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304211122"}]},"ts":"1676304211122"} 2023-02-13 16:03:31,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304211122"}]},"ts":"1676304211122"} 2023-02-13 16:03:31,124 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304211122"}]},"ts":"1676304211122"} 2023-02-13 16:03:31,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304211122"}]},"ts":"1676304211122"} 2023-02-13 16:03:31,125 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304211122"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304211122"}]},"ts":"1676304211122"} 2023-02-13 16:03:31,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:31,197 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 16:03:31,200 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:03:31,201 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304211201"}]},"ts":"1676304211201"} 2023-02-13 16:03:31,204 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 16:03:31,209 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:31,224 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:31,225 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:31,225 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:31,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f771c0f84d5513cee8c74cb9a669f3da, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e1cc34bf8ae0ff6d80f568e3df8d51ac, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08b03f0c40004487390286d5ac7bc159, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bf321661089a71e880fa4506d4b440a1, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b6ef70859660c5e71ec250c64943bdab, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7e2fac213f0894558e0b6e83b1bc8199, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7d3679b4d7608731a817f64e86875cfe, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=74aaf39c3cb3d5ead7b8147b9fc28eaf, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=15f5c1365441d7442a60654e2caee420, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cb76a17f03c6763538343ae979580d3f, ASSIGN}] 2023-02-13 16:03:31,230 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=cb76a17f03c6763538343ae979580d3f, ASSIGN 2023-02-13 16:03:31,231 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=74aaf39c3cb3d5ead7b8147b9fc28eaf, ASSIGN 2023-02-13 16:03:31,233 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7d3679b4d7608731a817f64e86875cfe, ASSIGN 2023-02-13 16:03:31,233 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=15f5c1365441d7442a60654e2caee420, ASSIGN 2023-02-13 16:03:31,235 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=cb76a17f03c6763538343ae979580d3f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41173,1676304207946; forceNewPlan=false, retain=false 2023-02-13 16:03:31,236 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=74aaf39c3cb3d5ead7b8147b9fc28eaf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41173,1676304207946; forceNewPlan=false, retain=false 2023-02-13 16:03:31,236 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=7e2fac213f0894558e0b6e83b1bc8199, ASSIGN 2023-02-13 16:03:31,236 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7d3679b4d7608731a817f64e86875cfe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36967,1676304208000; forceNewPlan=false, retain=false 2023-02-13 16:03:31,237 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=15f5c1365441d7442a60654e2caee420, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36967,1676304208000; forceNewPlan=false, retain=false 2023-02-13 16:03:31,239 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b6ef70859660c5e71ec250c64943bdab, ASSIGN 2023-02-13 16:03:31,239 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bf321661089a71e880fa4506d4b440a1, ASSIGN 2023-02-13 16:03:31,240 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=08b03f0c40004487390286d5ac7bc159, ASSIGN 2023-02-13 16:03:31,240 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=7e2fac213f0894558e0b6e83b1bc8199, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41173,1676304207946; forceNewPlan=false, retain=false 2023-02-13 16:03:31,241 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=e1cc34bf8ae0ff6d80f568e3df8d51ac, ASSIGN 2023-02-13 16:03:31,242 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b6ef70859660c5e71ec250c64943bdab, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36967,1676304208000; forceNewPlan=false, retain=false 2023-02-13 16:03:31,243 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bf321661089a71e880fa4506d4b440a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41173,1676304207946; forceNewPlan=false, retain=false 2023-02-13 16:03:31,243 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=08b03f0c40004487390286d5ac7bc159, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36967,1676304208000; forceNewPlan=false, retain=false 2023-02-13 16:03:31,243 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=f771c0f84d5513cee8c74cb9a669f3da, ASSIGN 2023-02-13 16:03:31,244 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=e1cc34bf8ae0ff6d80f568e3df8d51ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36967,1676304208000; forceNewPlan=false, retain=false 2023-02-13 16:03:31,246 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=f771c0f84d5513cee8c74cb9a669f3da, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41173,1676304207946; forceNewPlan=false, retain=false 2023-02-13 16:03:31,386 INFO [jenkins-hbase4:35105] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 16:03:31,389 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=bf321661089a71e880fa4506d4b440a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:31,389 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=cb76a17f03c6763538343ae979580d3f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:31,389 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7e2fac213f0894558e0b6e83b1bc8199, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:31,389 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=74aaf39c3cb3d5ead7b8147b9fc28eaf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:31,389 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f771c0f84d5513cee8c74cb9a669f3da, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:31,390 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304211389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304211389"}]},"ts":"1676304211389"} 2023-02-13 16:03:31,390 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304211389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304211389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304211389"}]},"ts":"1676304211389"} 2023-02-13 16:03:31,390 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304211389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304211389"}]},"ts":"1676304211389"} 2023-02-13 16:03:31,389 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304211389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304211389"}]},"ts":"1676304211389"} 2023-02-13 16:03:31,390 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304211389"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304211389"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304211389"}]},"ts":"1676304211389"} 2023-02-13 16:03:31,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=16, state=RUNNABLE; OpenRegionProcedure 7e2fac213f0894558e0b6e83b1bc8199, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:31,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=18, state=RUNNABLE; OpenRegionProcedure 74aaf39c3cb3d5ead7b8147b9fc28eaf, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:31,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=20, state=RUNNABLE; OpenRegionProcedure cb76a17f03c6763538343ae979580d3f, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:31,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=14, state=RUNNABLE; OpenRegionProcedure bf321661089a71e880fa4506d4b440a1, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:31,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=11, state=RUNNABLE; OpenRegionProcedure f771c0f84d5513cee8c74cb9a669f3da, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:31,402 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e1cc34bf8ae0ff6d80f568e3df8d51ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:31,403 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211402"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304211402"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304211402"}]},"ts":"1676304211402"} 2023-02-13 16:03:31,409 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=15f5c1365441d7442a60654e2caee420, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:31,409 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211409"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304211409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304211409"}]},"ts":"1676304211409"} 2023-02-13 16:03:31,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=12, state=RUNNABLE; OpenRegionProcedure e1cc34bf8ae0ff6d80f568e3df8d51ac, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:31,410 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=7d3679b4d7608731a817f64e86875cfe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:31,411 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=08b03f0c40004487390286d5ac7bc159, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:31,411 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211410"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304211410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304211410"}]},"ts":"1676304211410"} 2023-02-13 16:03:31,411 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304211411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304211411"}]},"ts":"1676304211411"} 2023-02-13 16:03:31,413 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b6ef70859660c5e71ec250c64943bdab, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:31,413 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211413"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304211413"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304211413"}]},"ts":"1676304211413"} 2023-02-13 16:03:31,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=19, state=RUNNABLE; OpenRegionProcedure 15f5c1365441d7442a60654e2caee420, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:31,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 7d3679b4d7608731a817f64e86875cfe, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:31,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=13, state=RUNNABLE; OpenRegionProcedure 08b03f0c40004487390286d5ac7bc159, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:31,420 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure b6ef70859660c5e71ec250c64943bdab, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:31,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:31,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:31,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7e2fac213f0894558e0b6e83b1bc8199, NAME => 'testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 16:03:31,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:31,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:31,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:31,559 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:31,561 DEBUG [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1 2023-02-13 16:03:31,561 DEBUG [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1 2023-02-13 16:03:31,562 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e2fac213f0894558e0b6e83b1bc8199 columnFamilyName f1 2023-02-13 16:03:31,563 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] regionserver.HStore(310): Store=7e2fac213f0894558e0b6e83b1bc8199/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,563 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:31,567 DEBUG [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2 2023-02-13 16:03:31,567 DEBUG [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2 2023-02-13 16:03:31,567 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e2fac213f0894558e0b6e83b1bc8199 columnFamilyName f2 2023-02-13 16:03:31,568 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] regionserver.HStore(310): Store=7e2fac213f0894558e0b6e83b1bc8199/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:31,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 08b03f0c40004487390286d5ac7bc159, NAME => 'testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 16:03:31,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:31,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:31,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:31,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:31,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:31,573 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:31,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:31,577 DEBUG [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1 2023-02-13 16:03:31,577 DEBUG [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1 2023-02-13 16:03:31,578 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08b03f0c40004487390286d5ac7bc159 columnFamilyName f1 2023-02-13 16:03:31,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:31,579 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] regionserver.HStore(310): Store=08b03f0c40004487390286d5ac7bc159/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,579 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:31,581 DEBUG [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2 2023-02-13 16:03:31,581 DEBUG [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2 2023-02-13 16:03:31,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:31,582 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08b03f0c40004487390286d5ac7bc159 columnFamilyName f2 2023-02-13 16:03:31,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7e2fac213f0894558e0b6e83b1bc8199; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72561282, jitterRate=0.08124735951423645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:31,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7e2fac213f0894558e0b6e83b1bc8199: Running coprocessor pre-open hook at 1676304211556Writing region info on filesystem at 1676304211556Initializing all the Stores at 1676304211558 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211558Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211559 (+1 ms)Cleaning up temporary data from old regions at 1676304211573 (+14 ms)Cleaning up detritus from prior splits at 1676304211573Running coprocessor post-open hooks at 1676304211583 (+10 ms)Region opened successfully at 1676304211583 2023-02-13 16:03:31,583 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] regionserver.HStore(310): Store=08b03f0c40004487390286d5ac7bc159/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199., pid=21, masterSystemTime=1676304211546 2023-02-13 16:03:31,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:31,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:31,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:31,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:31,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:31,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bf321661089a71e880fa4506d4b440a1, NAME => 'testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 16:03:31,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:31,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:31,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:31,589 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7e2fac213f0894558e0b6e83b1bc8199, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:31,589 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211589"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304211589"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304211589"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304211589"}]},"ts":"1676304211589"} 2023-02-13 16:03:31,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:31,592 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:31,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:31,595 DEBUG [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1 2023-02-13 16:03:31,595 DEBUG [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1 2023-02-13 16:03:31,595 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf321661089a71e880fa4506d4b440a1 columnFamilyName f1 2023-02-13 16:03:31,596 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] regionserver.HStore(310): Store=bf321661089a71e880fa4506d4b440a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,597 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:31,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=16 2023-02-13 16:03:31,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:31,598 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=16, state=SUCCESS; OpenRegionProcedure 7e2fac213f0894558e0b6e83b1bc8199, server=jenkins-hbase4.apache.org,41173,1676304207946 in 200 msec 2023-02-13 16:03:31,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 08b03f0c40004487390286d5ac7bc159; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65119711, jitterRate=-0.029640689492225647}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:31,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 08b03f0c40004487390286d5ac7bc159: Running coprocessor pre-open hook at 1676304211572Writing region info on filesystem at 1676304211572Initializing all the Stores at 1676304211573 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211573Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211573Cleaning up temporary data from old regions at 1676304211587 (+14 ms)Cleaning up detritus from prior splits at 1676304211588 (+1 ms)Running coprocessor post-open hooks at 1676304211599 (+11 ms)Region opened successfully at 1676304211599 2023-02-13 16:03:31,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159., pid=29, masterSystemTime=1676304211563 2023-02-13 16:03:31,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7e2fac213f0894558e0b6e83b1bc8199, ASSIGN in 372 msec 2023-02-13 16:03:31,602 DEBUG [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2 2023-02-13 16:03:31,602 DEBUG [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2 2023-02-13 16:03:31,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:31,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:31,603 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf321661089a71e880fa4506d4b440a1 columnFamilyName f2 2023-02-13 16:03:31,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:31,604 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=08b03f0c40004487390286d5ac7bc159, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:31,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b6ef70859660c5e71ec250c64943bdab, NAME => 'testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 16:03:31,608 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211604"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304211604"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304211604"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304211604"}]},"ts":"1676304211604"} 2023-02-13 16:03:31,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:31,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:31,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:31,609 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] regionserver.HStore(310): Store=bf321661089a71e880fa4506d4b440a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:31,612 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:31,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:31,614 DEBUG [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1 2023-02-13 16:03:31,614 DEBUG [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1 2023-02-13 16:03:31,615 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6ef70859660c5e71ec250c64943bdab columnFamilyName f1 2023-02-13 16:03:31,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:31,616 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] regionserver.HStore(310): Store=b6ef70859660c5e71ec250c64943bdab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=13 2023-02-13 16:03:31,617 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:31,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=13, state=SUCCESS; OpenRegionProcedure 08b03f0c40004487390286d5ac7bc159, server=jenkins-hbase4.apache.org,36967,1676304208000 in 193 msec 2023-02-13 16:03:31,620 DEBUG [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2 2023-02-13 16:03:31,620 DEBUG [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2 2023-02-13 16:03:31,622 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6ef70859660c5e71ec250c64943bdab columnFamilyName f2 2023-02-13 16:03:31,623 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] regionserver.HStore(310): Store=b6ef70859660c5e71ec250c64943bdab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:31,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:31,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=08b03f0c40004487390286d5ac7bc159, ASSIGN in 392 msec 2023-02-13 16:03:31,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:31,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:31,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:31,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:31,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bf321661089a71e880fa4506d4b440a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65166373, jitterRate=-0.028945371508598328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:31,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bf321661089a71e880fa4506d4b440a1: Running coprocessor pre-open hook at 1676304211589Writing region info on filesystem at 1676304211589Initializing all the Stores at 1676304211590 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211591 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211591Cleaning up temporary data from old regions at 1676304211613 (+22 ms)Cleaning up detritus from prior splits at 1676304211614 (+1 ms)Running coprocessor post-open hooks at 1676304211638 (+24 ms)Region opened successfully at 1676304211638 2023-02-13 16:03:31,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:31,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1., pid=24, masterSystemTime=1676304211546 2023-02-13 16:03:31,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b6ef70859660c5e71ec250c64943bdab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69859329, jitterRate=0.040985122323036194}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:31,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b6ef70859660c5e71ec250c64943bdab: Running coprocessor pre-open hook at 1676304211609Writing region info on filesystem at 1676304211609Initializing all the Stores at 1676304211611 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211611Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211611Cleaning up temporary data from old regions at 1676304211628 (+17 ms)Cleaning up detritus from prior splits at 1676304211631 (+3 ms)Running coprocessor post-open hooks at 1676304211640 (+9 ms)Region opened successfully at 1676304211640 2023-02-13 16:03:31,641 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab., pid=30, masterSystemTime=1676304211563 2023-02-13 16:03:31,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:31,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:31,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:31,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => f771c0f84d5513cee8c74cb9a669f3da, NAME => 'testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 16:03:31,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:31,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:31,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:31,646 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=bf321661089a71e880fa4506d4b440a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:31,646 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211646"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304211646"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304211646"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304211646"}]},"ts":"1676304211646"} 2023-02-13 16:03:31,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:31,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:31,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:31,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e1cc34bf8ae0ff6d80f568e3df8d51ac, NAME => 'testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 16:03:31,647 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:31,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:31,648 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b6ef70859660c5e71ec250c64943bdab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:31,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:31,648 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211648"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304211648"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304211648"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304211648"}]},"ts":"1676304211648"} 2023-02-13 16:03:31,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:31,651 DEBUG [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/f1 2023-02-13 16:03:31,651 DEBUG [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/f1 2023-02-13 16:03:31,652 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f771c0f84d5513cee8c74cb9a669f3da columnFamilyName f1 2023-02-13 16:03:31,653 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:31,653 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] regionserver.HStore(310): Store=f771c0f84d5513cee8c74cb9a669f3da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,653 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:31,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=14 2023-02-13 16:03:31,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=14, state=SUCCESS; OpenRegionProcedure bf321661089a71e880fa4506d4b440a1, server=jenkins-hbase4.apache.org,41173,1676304207946 in 250 msec 2023-02-13 16:03:31,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-13 16:03:31,656 DEBUG [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1 2023-02-13 16:03:31,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure b6ef70859660c5e71ec250c64943bdab, server=jenkins-hbase4.apache.org,36967,1676304208000 in 231 msec 2023-02-13 16:03:31,656 DEBUG [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1 2023-02-13 16:03:31,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bf321661089a71e880fa4506d4b440a1, ASSIGN in 429 msec 2023-02-13 16:03:31,657 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1cc34bf8ae0ff6d80f568e3df8d51ac columnFamilyName f1 2023-02-13 16:03:31,657 DEBUG [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/f2 2023-02-13 16:03:31,657 DEBUG [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/f2 2023-02-13 16:03:31,658 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f771c0f84d5513cee8c74cb9a669f3da columnFamilyName f2 2023-02-13 16:03:31,658 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] regionserver.HStore(310): Store=e1cc34bf8ae0ff6d80f568e3df8d51ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,658 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:31,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b6ef70859660c5e71ec250c64943bdab, ASSIGN in 431 msec 2023-02-13 16:03:31,658 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] regionserver.HStore(310): Store=f771c0f84d5513cee8c74cb9a669f3da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:31,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:31,661 DEBUG [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2 2023-02-13 16:03:31,661 DEBUG [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2 2023-02-13 16:03:31,662 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1cc34bf8ae0ff6d80f568e3df8d51ac columnFamilyName f2 2023-02-13 16:03:31,663 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] regionserver.HStore(310): Store=e1cc34bf8ae0ff6d80f568e3df8d51ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:31,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:31,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:31,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:31,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:31,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:31,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened f771c0f84d5513cee8c74cb9a669f3da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60341828, jitterRate=-0.10083669424057007}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:31,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for f771c0f84d5513cee8c74cb9a669f3da: Running coprocessor pre-open hook at 1676304211645Writing region info on filesystem at 1676304211645Initializing all the Stores at 1676304211647 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211647Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211647Cleaning up temporary data from old regions at 1676304211662 (+15 ms)Cleaning up detritus from prior splits at 1676304211663 (+1 ms)Running coprocessor post-open hooks at 1676304211671 (+8 ms)Region opened successfully at 1676304211671 2023-02-13 16:03:31,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:31,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da., pid=25, masterSystemTime=1676304211546 2023-02-13 16:03:31,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:31,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:31,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:31,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cb76a17f03c6763538343ae979580d3f, NAME => 'testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 16:03:31,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:31,677 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=f771c0f84d5513cee8c74cb9a669f3da, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:31,677 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304211676"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304211676"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304211676"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304211676"}]},"ts":"1676304211676"} 2023-02-13 16:03:31,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:31,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e1cc34bf8ae0ff6d80f568e3df8d51ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74503650, jitterRate=0.11019089818000793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:31,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:31,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:31,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e1cc34bf8ae0ff6d80f568e3df8d51ac: Running coprocessor pre-open hook at 1676304211649Writing region info on filesystem at 1676304211649Initializing all the Stores at 1676304211652 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211652Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211653 (+1 ms)Cleaning up temporary data from old regions at 1676304211668 (+15 ms)Cleaning up detritus from prior splits at 1676304211668Running coprocessor post-open hooks at 1676304211678 (+10 ms)Region opened successfully at 1676304211678 2023-02-13 16:03:31,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac., pid=26, masterSystemTime=1676304211563 2023-02-13 16:03:31,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=11 2023-02-13 16:03:31,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=11, state=SUCCESS; OpenRegionProcedure f771c0f84d5513cee8c74cb9a669f3da, server=jenkins-hbase4.apache.org,41173,1676304207946 in 279 msec 2023-02-13 16:03:31,684 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:31,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:31,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:31,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:31,685 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e1cc34bf8ae0ff6d80f568e3df8d51ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:31,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 15f5c1365441d7442a60654e2caee420, NAME => 'testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 16:03:31,685 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211685"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304211685"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304211685"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304211685"}]},"ts":"1676304211685"} 2023-02-13 16:03:31,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:31,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:31,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:31,687 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f771c0f84d5513cee8c74cb9a669f3da, ASSIGN in 459 msec 2023-02-13 16:03:31,688 DEBUG [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/f1 2023-02-13 16:03:31,688 DEBUG [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/f1 2023-02-13 16:03:31,688 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb76a17f03c6763538343ae979580d3f columnFamilyName f1 2023-02-13 16:03:31,690 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] regionserver.HStore(310): Store=cb76a17f03c6763538343ae979580d3f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,690 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:31,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=12 2023-02-13 16:03:31,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=12, state=SUCCESS; OpenRegionProcedure e1cc34bf8ae0ff6d80f568e3df8d51ac, server=jenkins-hbase4.apache.org,36967,1676304208000 in 279 msec 2023-02-13 16:03:31,693 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:31,694 DEBUG [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/f2 2023-02-13 16:03:31,694 DEBUG [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/f2 2023-02-13 16:03:31,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e1cc34bf8ae0ff6d80f568e3df8d51ac, ASSIGN in 467 msec 2023-02-13 16:03:31,694 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb76a17f03c6763538343ae979580d3f columnFamilyName f2 2023-02-13 16:03:31,695 DEBUG [StoreOpener-15f5c1365441d7442a60654e2caee420-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1 2023-02-13 16:03:31,695 DEBUG [StoreOpener-15f5c1365441d7442a60654e2caee420-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1 2023-02-13 16:03:31,695 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] regionserver.HStore(310): Store=cb76a17f03c6763538343ae979580d3f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,695 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15f5c1365441d7442a60654e2caee420 columnFamilyName f1 2023-02-13 16:03:31,697 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] regionserver.HStore(310): Store=15f5c1365441d7442a60654e2caee420/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,697 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:31,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:31,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:31,699 DEBUG [StoreOpener-15f5c1365441d7442a60654e2caee420-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2 2023-02-13 16:03:31,699 DEBUG [StoreOpener-15f5c1365441d7442a60654e2caee420-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2 2023-02-13 16:03:31,700 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15f5c1365441d7442a60654e2caee420 columnFamilyName f2 2023-02-13 16:03:31,701 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] regionserver.HStore(310): Store=15f5c1365441d7442a60654e2caee420/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:31,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:31,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:31,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:31,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:31,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:31,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:31,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened cb76a17f03c6763538343ae979580d3f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72268790, jitterRate=0.07688888907432556}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:31,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for cb76a17f03c6763538343ae979580d3f: Running coprocessor pre-open hook at 1676304211678Writing region info on filesystem at 1676304211678Initializing all the Stores at 1676304211679 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211679Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211684 (+5 ms)Cleaning up temporary data from old regions at 1676304211699 (+15 ms)Cleaning up detritus from prior splits at 1676304211700 (+1 ms)Running coprocessor post-open hooks at 1676304211713 (+13 ms)Region opened successfully at 1676304211713 2023-02-13 16:03:31,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f., pid=23, masterSystemTime=1676304211546 2023-02-13 16:03:31,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:31,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:31,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:31,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 15f5c1365441d7442a60654e2caee420; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73604857, jitterRate=0.09679783880710602}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:31,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 15f5c1365441d7442a60654e2caee420: Running coprocessor pre-open hook at 1676304211686Writing region info on filesystem at 1676304211686Initializing all the Stores at 1676304211688 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211688Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211692 (+4 ms)Cleaning up temporary data from old regions at 1676304211705 (+13 ms)Cleaning up detritus from prior splits at 1676304211706 (+1 ms)Running coprocessor post-open hooks at 1676304211718 (+12 ms)Region opened successfully at 1676304211718 2023-02-13 16:03:31,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:31,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 74aaf39c3cb3d5ead7b8147b9fc28eaf, NAME => 'testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 16:03:31,718 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=cb76a17f03c6763538343ae979580d3f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:31,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420., pid=27, masterSystemTime=1676304211563 2023-02-13 16:03:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:31,719 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304211718"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304211718"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304211718"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304211718"}]},"ts":"1676304211718"} 2023-02-13 16:03:31,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:31,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:31,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:31,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:31,722 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:31,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7d3679b4d7608731a817f64e86875cfe, NAME => 'testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 16:03:31,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:31,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:31,723 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=15f5c1365441d7442a60654e2caee420, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:31,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:31,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:31,723 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211722"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304211722"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304211722"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304211722"}]},"ts":"1676304211722"} 2023-02-13 16:03:31,725 DEBUG [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1 2023-02-13 16:03:31,725 DEBUG [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1 2023-02-13 16:03:31,725 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:31,726 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74aaf39c3cb3d5ead7b8147b9fc28eaf columnFamilyName f1 2023-02-13 16:03:31,727 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] regionserver.HStore(310): Store=74aaf39c3cb3d5ead7b8147b9fc28eaf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,727 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:31,727 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=20 2023-02-13 16:03:31,727 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=20, state=SUCCESS; OpenRegionProcedure cb76a17f03c6763538343ae979580d3f, server=jenkins-hbase4.apache.org,41173,1676304207946 in 326 msec 2023-02-13 16:03:31,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cb76a17f03c6763538343ae979580d3f, ASSIGN in 502 msec 2023-02-13 16:03:31,730 DEBUG [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2 2023-02-13 16:03:31,730 DEBUG [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2 2023-02-13 16:03:31,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=19 2023-02-13 16:03:31,731 DEBUG [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1 2023-02-13 16:03:31,731 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=19, state=SUCCESS; OpenRegionProcedure 15f5c1365441d7442a60654e2caee420, server=jenkins-hbase4.apache.org,36967,1676304208000 in 313 msec 2023-02-13 16:03:31,731 DEBUG [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1 2023-02-13 16:03:31,731 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74aaf39c3cb3d5ead7b8147b9fc28eaf columnFamilyName f2 2023-02-13 16:03:31,732 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d3679b4d7608731a817f64e86875cfe columnFamilyName f1 2023-02-13 16:03:31,732 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] regionserver.HStore(310): Store=74aaf39c3cb3d5ead7b8147b9fc28eaf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,734 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] regionserver.HStore(310): Store=7d3679b4d7608731a817f64e86875cfe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,734 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:31,734 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=15f5c1365441d7442a60654e2caee420, ASSIGN in 506 msec 2023-02-13 16:03:31,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:31,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:31,736 DEBUG [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2 2023-02-13 16:03:31,736 DEBUG [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2 2023-02-13 16:03:31,737 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d3679b4d7608731a817f64e86875cfe columnFamilyName f2 2023-02-13 16:03:31,738 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] regionserver.HStore(310): Store=7d3679b4d7608731a817f64e86875cfe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:31,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:31,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:31,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:31,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:31,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:31,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:31,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 74aaf39c3cb3d5ead7b8147b9fc28eaf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68370678, jitterRate=0.018802493810653687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:31,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 74aaf39c3cb3d5ead7b8147b9fc28eaf: Running coprocessor pre-open hook at 1676304211719Writing region info on filesystem at 1676304211719Initializing all the Stores at 1676304211721 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211721Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211721Cleaning up temporary data from old regions at 1676304211737 (+16 ms)Cleaning up detritus from prior splits at 1676304211737Running coprocessor post-open hooks at 1676304211746 (+9 ms)Region opened successfully at 1676304211746 2023-02-13 16:03:31,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:31,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf., pid=22, masterSystemTime=1676304211546 2023-02-13 16:03:31,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:31,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:31,751 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=74aaf39c3cb3d5ead7b8147b9fc28eaf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:31,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:31,751 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211751"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304211751"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304211751"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304211751"}]},"ts":"1676304211751"} 2023-02-13 16:03:31,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7d3679b4d7608731a817f64e86875cfe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75181734, jitterRate=0.12029513716697693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:31,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7d3679b4d7608731a817f64e86875cfe: Running coprocessor pre-open hook at 1676304211723Writing region info on filesystem at 1676304211723Initializing all the Stores at 1676304211724 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211724Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304211725 (+1 ms)Cleaning up temporary data from old regions at 1676304211742 (+17 ms)Cleaning up detritus from prior splits at 1676304211743 (+1 ms)Running coprocessor post-open hooks at 1676304211752 (+9 ms)Region opened successfully at 1676304211752 2023-02-13 16:03:31,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe., pid=28, masterSystemTime=1676304211563 2023-02-13 16:03:31,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:31,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:31,757 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=7d3679b4d7608731a817f64e86875cfe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:31,757 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304211757"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304211757"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304211757"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304211757"}]},"ts":"1676304211757"} 2023-02-13 16:03:31,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=18 2023-02-13 16:03:31,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=18, state=SUCCESS; OpenRegionProcedure 74aaf39c3cb3d5ead7b8147b9fc28eaf, server=jenkins-hbase4.apache.org,41173,1676304207946 in 359 msec 2023-02-13 16:03:31,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=74aaf39c3cb3d5ead7b8147b9fc28eaf, ASSIGN in 533 msec 2023-02-13 16:03:31,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-13 16:03:31,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 7d3679b4d7608731a817f64e86875cfe, server=jenkins-hbase4.apache.org,36967,1676304208000 in 345 msec 2023-02-13 16:03:31,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-13 16:03:31,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7d3679b4d7608731a817f64e86875cfe, ASSIGN in 539 msec 2023-02-13 16:03:31,768 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:03:31,768 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304211768"}]},"ts":"1676304211768"} 2023-02-13 16:03:31,771 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 16:03:31,777 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:03:31,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 919 msec 2023-02-13 16:03:31,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:31,997 INFO [Listener at localhost/36263] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 16:03:31,997 DEBUG [Listener at localhost/36263] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 16:03:31,999 INFO [Listener at localhost/36263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:03:32,010 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 16:03:32,011 INFO [Listener at localhost/36263] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:03:32,011 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 16:03:32,011 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 16:03:32,129 DEBUG [hconnection-0xed0c6d0-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:32,202 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:32,243 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41173] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:32,252 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36967] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:32,568 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 16:03:32,571 INFO [Listener at localhost/36263] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 16:03:32,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 16:03:32,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676304212586 (current time:1676304212586). 2023-02-13 16:03:32,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 16:03:32,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] zookeeper.ReadOnlyZKClient(139): Connect 0x4b3de4a0 to 127.0.0.1:64487 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:32,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f3b6949, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:32,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:32,603 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35062, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:32,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b3de4a0 to 127.0.0.1:64487 2023-02-13 16:03:32,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:32,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 16:03:32,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 16:03:32,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 16:03:32,634 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 16:03:32,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 16:03:32,636 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676304812636 2023-02-13 16:03:32,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 16:03:32,640 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 16:03:32,642 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 16:03:32,642 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 16:03:32,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 16:03:32,644 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 15 msec 2023-02-13 16:03:32,645 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 16:03:32,646 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676304812646 2023-02-13 16:03:32,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceMultiRegion 2023-02-13 16:03:32,687 INFO [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceMultiRegion' 2023-02-13 16:03:32,687 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:32,687 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceMultiRegion' starting 'acquire' 2023-02-13 16:03:32,687 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 16:03:32,709 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:32,709 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 16:03:32,711 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:32,711 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:32,711 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:32,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:32,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:32,712 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:32,712 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 16:03:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 16:03:32,712 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:32,712 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:03:32,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:32,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-13 16:03:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 66 2023-02-13 16:03:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 16:03:32,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 16:03:32,713 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 16:03:32,713 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 16:03:32,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-13 16:03:32,716 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceMultiRegion 2023-02-13 16:03:32,717 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-13 16:03:32,717 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceMultiRegion' with timeout 300000ms 2023-02-13 16:03:32,717 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:32,717 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:32,717 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 16:03:32,718 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 16:03:32,718 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-13 16:03:32,718 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceMultiRegion' locally acquired 2023-02-13 16:03:32,718 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36967,1676304208000' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-13 16:03:32,718 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41173,1676304207946' joining acquired barrier for procedure (testWithMapReduceMultiRegion) in zk 2023-02-13 16:03:32,721 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,721 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,721 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:32,721 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:32,721 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,721 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,721 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:32,721 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 16:03:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:32,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36967,1676304208000' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-13 16:03:32,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42c49bf7[Count = 1] remaining members to acquire global barrier 2023-02-13 16:03:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 16:03:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:32,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41173,1676304207946' joining acquired barrier for procedure 'testWithMapReduceMultiRegion' on coordinator 2023-02-13 16:03:32,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42c49bf7[Count = 0] remaining members to acquire global barrier 2023-02-13 16:03:32,726 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 16:03:32,727 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,728 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,728 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:32,729 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 16:03:32,729 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:32,729 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:32,729 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:03:32,729 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 16:03:32,730 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:32,730 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:32,730 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. started... 2023-02-13 16:03:32,730 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. started... 2023-02-13 16:03:32,732 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 7e2fac213f0894558e0b6e83b1bc8199 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:32,733 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for f771c0f84d5513cee8c74cb9a669f3da: 2023-02-13 16:03:32,734 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:32,741 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:32,742 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:32,742 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 16:03:32,743 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:32,743 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 16:03:32,743 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:32,744 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:32,744 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. started... 2023-02-13 16:03:32,744 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 16:03:32,745 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 16:03:32,744 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:32,743 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. started... 2023-02-13 16:03:32,746 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. started... 2023-02-13 16:03:32,746 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:32,747 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e1cc34bf8ae0ff6d80f568e3df8d51ac 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 16:03:32,747 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:32,745 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] regionserver.HRegion(2744): Flushing b6ef70859660c5e71ec250c64943bdab 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:32,749 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 7d3679b4d7608731a817f64e86875cfe 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:32,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:03:32,744 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. started... 2023-02-13 16:03:32,751 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 74aaf39c3cb3d5ead7b8147b9fc28eaf 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:32,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:32,753 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 16:03:32,792 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. completed. 2023-02-13 16:03:32,792 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:32,793 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:32,793 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 16:03:32,793 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. started... 2023-02-13 16:03:32,794 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] regionserver.HRegion(2744): Flushing bf321661089a71e880fa4506d4b440a1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:32,954 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:32,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:03:32,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:32,956 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 16:03:33,024 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/.tmp/f1/c4d1eff3678744e2a8626ac9b942a5b6 2023-02-13 16:03:33,044 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/.tmp/f1/35fd86457970482aae6a8e05d7b2ea47 2023-02-13 16:03:33,058 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/.tmp/f1/e4b2c2a8d8ca4271931450c90448cede 2023-02-13 16:03:33,073 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/.tmp/f1/d76a201d1a39417989deff4e30fba100 2023-02-13 16:03:33,201 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/.tmp/f2/83e5c2a2a0ff4f678ffac14168485930 2023-02-13 16:03:33,212 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/.tmp/f2/bc49fa2121264a66bd07d99d94a34e0e 2023-02-13 16:03:33,216 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/.tmp/f2/32bf4aa95e4940208f4725964dfb7f94 2023-02-13 16:03:33,219 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/.tmp/f1/d76a201d1a39417989deff4e30fba100 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/d76a201d1a39417989deff4e30fba100 2023-02-13 16:03:33,229 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/.tmp/f1/35fd86457970482aae6a8e05d7b2ea47 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/35fd86457970482aae6a8e05d7b2ea47 2023-02-13 16:03:33,230 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/.tmp/f1/e4b2c2a8d8ca4271931450c90448cede as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/e4b2c2a8d8ca4271931450c90448cede 2023-02-13 16:03:33,236 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/d76a201d1a39417989deff4e30fba100, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,238 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/35fd86457970482aae6a8e05d7b2ea47, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,240 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/.tmp/f2/bc49fa2121264a66bd07d99d94a34e0e as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/bc49fa2121264a66bd07d99d94a34e0e 2023-02-13 16:03:33,241 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/.tmp/f2/83e5c2a2a0ff4f678ffac14168485930 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/83e5c2a2a0ff4f678ffac14168485930 2023-02-13 16:03:33,248 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/e4b2c2a8d8ca4271931450c90448cede, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:33,249 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/.tmp/f2/32bf4aa95e4940208f4725964dfb7f94 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/32bf4aa95e4940208f4725964dfb7f94 2023-02-13 16:03:33,252 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/bc49fa2121264a66bd07d99d94a34e0e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,252 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/83e5c2a2a0ff4f678ffac14168485930, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,254 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7e2fac213f0894558e0b6e83b1bc8199 in 522ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:33,254 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 7d3679b4d7608731a817f64e86875cfe in 505ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:33,255 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 16:03:33,255 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 16:03:33,257 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:33,259 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 7d3679b4d7608731a817f64e86875cfe: 2023-02-13 16:03:33,259 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 7e2fac213f0894558e0b6e83b1bc8199: 2023-02-13 16:03:33,259 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,259 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,259 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:33,259 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:33,259 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/35fd86457970482aae6a8e05d7b2ea47] hfiles 2023-02-13 16:03:33,259 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/d76a201d1a39417989deff4e30fba100] hfiles 2023-02-13 16:03:33,259 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/35fd86457970482aae6a8e05d7b2ea47 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,259 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/d76a201d1a39417989deff4e30fba100 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:03:33,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:33,260 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 16:03:33,265 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/83e5c2a2a0ff4f678ffac14168485930] hfiles 2023-02-13 16:03:33,265 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/83e5c2a2a0ff4f678ffac14168485930 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,265 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/bc49fa2121264a66bd07d99d94a34e0e] hfiles 2023-02-13 16:03:33,265 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/bc49fa2121264a66bd07d99d94a34e0e for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,265 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/32bf4aa95e4940208f4725964dfb7f94, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:33,266 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e1cc34bf8ae0ff6d80f568e3df8d51ac in 519ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:33,266 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e1cc34bf8ae0ff6d80f568e3df8d51ac: 2023-02-13 16:03:33,267 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,267 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:33,267 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/e4b2c2a8d8ca4271931450c90448cede] hfiles 2023-02-13 16:03:33,268 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/e4b2c2a8d8ca4271931450c90448cede for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,268 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/32bf4aa95e4940208f4725964dfb7f94] hfiles 2023-02-13 16:03:33,269 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/32bf4aa95e4940208f4725964dfb7f94 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,297 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. completed. 2023-02-13 16:03:33,297 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:33,297 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:33,297 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 16:03:33,298 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. completed. 2023-02-13 16:03:33,298 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:33,298 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:33,298 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 16:03:33,299 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. started... 2023-02-13 16:03:33,298 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. started... 2023-02-13 16:03:33,299 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 15f5c1365441d7442a60654e2caee420 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 16:03:33,300 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for cb76a17f03c6763538343ae979580d3f: 2023-02-13 16:03:33,301 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,301 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:33,301 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:33,301 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:33,303 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. completed. 2023-02-13 16:03:33,303 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:33,304 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:33,304 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 16:03:33,304 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. started... 2023-02-13 16:03:33,305 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 08b03f0c40004487390286d5ac7bc159 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:33,330 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. completed. 2023-02-13 16:03:33,330 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:33,330 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 16:03:33,348 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/.tmp/f1/c2cefe56945d484bb1bb6f9b6fe01fb7 2023-02-13 16:03:33,350 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/.tmp/f1/666c25bb365640cb95515df874935ed4 2023-02-13 16:03:33,403 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/.tmp/f2/98d8cb8f8fd2493f94e663ff24d9b139 2023-02-13 16:03:33,403 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/.tmp/f2/d5c2df1227974d41abcd39805abf6d23 2023-02-13 16:03:33,420 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/.tmp/f1/666c25bb365640cb95515df874935ed4 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/666c25bb365640cb95515df874935ed4 2023-02-13 16:03:33,420 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/.tmp/f1/c2cefe56945d484bb1bb6f9b6fe01fb7 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/c2cefe56945d484bb1bb6f9b6fe01fb7 2023-02-13 16:03:33,428 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/666c25bb365640cb95515df874935ed4, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:33,428 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/c2cefe56945d484bb1bb6f9b6fe01fb7, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,429 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/.tmp/f2/98d8cb8f8fd2493f94e663ff24d9b139 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/98d8cb8f8fd2493f94e663ff24d9b139 2023-02-13 16:03:33,429 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/.tmp/f2/d5c2df1227974d41abcd39805abf6d23 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/d5c2df1227974d41abcd39805abf6d23 2023-02-13 16:03:33,441 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/98d8cb8f8fd2493f94e663ff24d9b139, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:33,448 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 15f5c1365441d7442a60654e2caee420 in 149ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:33,448 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 15f5c1365441d7442a60654e2caee420: 2023-02-13 16:03:33,449 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,449 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:33,449 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/d5c2df1227974d41abcd39805abf6d23, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,449 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/666c25bb365640cb95515df874935ed4] hfiles 2023-02-13 16:03:33,449 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/666c25bb365640cb95515df874935ed4 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,449 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/98d8cb8f8fd2493f94e663ff24d9b139] hfiles 2023-02-13 16:03:33,449 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/98d8cb8f8fd2493f94e663ff24d9b139 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,451 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 08b03f0c40004487390286d5ac7bc159 in 146ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:33,451 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 08b03f0c40004487390286d5ac7bc159: 2023-02-13 16:03:33,452 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,452 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:33,452 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/c2cefe56945d484bb1bb6f9b6fe01fb7] hfiles 2023-02-13 16:03:33,452 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/c2cefe56945d484bb1bb6f9b6fe01fb7 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,452 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/d5c2df1227974d41abcd39805abf6d23] hfiles 2023-02-13 16:03:33,452 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/d5c2df1227974d41abcd39805abf6d23 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,460 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/.tmp/f1/9423ed41c51d47d9bcf929df0cbfad9d 2023-02-13 16:03:33,479 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/.tmp/f1/79f3d87d6ad0455691dbae34ecb41177 2023-02-13 16:03:33,524 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. completed. 2023-02-13 16:03:33,524 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:33,524 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 16:03:33,524 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. completed. 2023-02-13 16:03:33,525 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:33,525 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 16:03:33,540 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/.tmp/f2/f1d5969ba76f49219558bae0556fcb4d 2023-02-13 16:03:33,549 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/.tmp/f2/c2597eade29a44868ef8377f5d629c6b 2023-02-13 16:03:33,549 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/.tmp/f1/9423ed41c51d47d9bcf929df0cbfad9d as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/9423ed41c51d47d9bcf929df0cbfad9d 2023-02-13 16:03:33,557 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/.tmp/f1/79f3d87d6ad0455691dbae34ecb41177 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/79f3d87d6ad0455691dbae34ecb41177 2023-02-13 16:03:33,558 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/9423ed41c51d47d9bcf929df0cbfad9d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,565 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/.tmp/f2/f1d5969ba76f49219558bae0556fcb4d as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/f1d5969ba76f49219558bae0556fcb4d 2023-02-13 16:03:33,577 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/f1d5969ba76f49219558bae0556fcb4d, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,578 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 74aaf39c3cb3d5ead7b8147b9fc28eaf in 827ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:33,578 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 74aaf39c3cb3d5ead7b8147b9fc28eaf: 2023-02-13 16:03:33,579 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,579 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:33,579 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/9423ed41c51d47d9bcf929df0cbfad9d] hfiles 2023-02-13 16:03:33,579 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/9423ed41c51d47d9bcf929df0cbfad9d for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,579 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/f1d5969ba76f49219558bae0556fcb4d] hfiles 2023-02-13 16:03:33,579 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/f1d5969ba76f49219558bae0556fcb4d for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,583 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/79f3d87d6ad0455691dbae34ecb41177, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,584 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/.tmp/f2/c2597eade29a44868ef8377f5d629c6b as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/c2597eade29a44868ef8377f5d629c6b 2023-02-13 16:03:33,586 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/.tmp/f2/06b894aee7a54f0fab09406bd77e03e2 2023-02-13 16:03:33,596 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/.tmp/f1/c4d1eff3678744e2a8626ac9b942a5b6 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/c4d1eff3678744e2a8626ac9b942a5b6 2023-02-13 16:03:33,597 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/c2597eade29a44868ef8377f5d629c6b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,598 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b6ef70859660c5e71ec250c64943bdab in 853ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:33,598 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b6ef70859660c5e71ec250c64943bdab: 2023-02-13 16:03:33,599 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,599 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:33,599 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/79f3d87d6ad0455691dbae34ecb41177] hfiles 2023-02-13 16:03:33,599 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/79f3d87d6ad0455691dbae34ecb41177 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,599 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/c2597eade29a44868ef8377f5d629c6b] hfiles 2023-02-13 16:03:33,599 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/c2597eade29a44868ef8377f5d629c6b for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,617 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/c4d1eff3678744e2a8626ac9b942a5b6, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,618 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/.tmp/f2/06b894aee7a54f0fab09406bd77e03e2 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/06b894aee7a54f0fab09406bd77e03e2 2023-02-13 16:03:33,636 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/06b894aee7a54f0fab09406bd77e03e2, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:33,637 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for bf321661089a71e880fa4506d4b440a1 in 843ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:33,637 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for bf321661089a71e880fa4506d4b440a1: 2023-02-13 16:03:33,637 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.' region-info for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,637 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:33,637 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/c4d1eff3678744e2a8626ac9b942a5b6] hfiles 2023-02-13 16:03:33,637 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/c4d1eff3678744e2a8626ac9b942a5b6 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,638 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/06b894aee7a54f0fab09406bd77e03e2] hfiles 2023-02-13 16:03:33,638 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/06b894aee7a54f0fab09406bd77e03e2 for snapshot=testWithMapReduceMultiRegion 2023-02-13 16:03:33,639 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. completed. 2023-02-13 16:03:33,639 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:33,639 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 16:03:33,652 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. completed. 2023-02-13 16:03:33,652 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:33,652 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 16:03:33,652 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 16:03:33,652 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,652 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-13 16:03:33,653 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,36967,1676304208000' in zk 2023-02-13 16:03:33,656 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,656 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-13 16:03:33,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:33,657 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-13 16:03:33,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:33,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 16:03:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 16:03:33,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,36967,1676304208000': 2023-02-13 16:03:33,662 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. completed. 2023-02-13 16:03:33,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36967,1676304208000' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 16:03:33,662 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:33,662 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 16:03:33,662 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 16:03:33,662 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,662 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceMultiRegion' locally completed 2023-02-13 16:03:33,662 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,41173,1676304207946' in zk 2023-02-13 16:03:33,664 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceMultiRegion' has notified controller of completion 2023-02-13 16:03:33,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:33,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:33,664 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:33,665 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceMultiRegion' completed. 2023-02-13 16:03:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:33,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 16:03:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 16:03:33,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,41173,1676304207946': 2023-02-13 16:03:33,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41173,1676304207946' released barrier for procedure'testWithMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 16:03:33,670 INFO [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceMultiRegion' execution completed 2023-02-13 16:03:33,670 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:03:33,670 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:03:33,670 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceMultiRegion 2023-02-13 16:03:33,670 INFO [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 16:03:33,674 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,674 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,674 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,674 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:33,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,674 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:33,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:33,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:33,675 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:33,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,676 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 16:03:33,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:33,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 16:03:33,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,679 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:33,680 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceMultiRegion 2023-02-13 16:03:33,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,697 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:33,697 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:33,697 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,697 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 16:03:33,697 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,697 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceMultiRegion 2023-02-13 16:03:33,697 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:33,697 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:33,698 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:33,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceMultiRegion 2023-02-13 16:03:33,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceMultiRegion 2023-02-13 16:03:33,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:33,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:33,697 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:33,698 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceMultiRegion 2023-02-13 16:03:33,704 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceMultiRegion 2023-02-13 16:03:33,698 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:33,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:33,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:33,697 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:33,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:33,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:33,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:33,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:33,708 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 16:03:33,761 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:33,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:03:33,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:33,772 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 16:03:33,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.hbase-snapshot/testWithMapReduceMultiRegion 2023-02-13 16:03:33,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed 2023-02-13 16:03:33,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 16:03:33,847 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.hbase-snapshot/.tmp/testWithMapReduceMultiRegion 2023-02-13 16:03:33,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676304212639Consolidate snapshot: testWithMapReduceMultiRegion at 1676304213698 (+1059 ms)Loading Region manifests for testWithMapReduceMultiRegion at 1676304213704 (+6 ms)Writing data manifest for testWithMapReduceMultiRegion at 1676304213744 (+40 ms)Verifying snapshot: testWithMapReduceMultiRegion at 1676304213777 (+33 ms)Snapshot testWithMapReduceMultiRegion of table testWithMapReduce completed at 1676304213846 (+69 ms) 2023-02-13 16:03:33,849 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 16:03:33,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.2080 sec 2023-02-13 16:03:34,772 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:34,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:03:34,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 16:03:34,774 INFO [Listener at localhost/36263] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 16:03:34,788 INFO [Listener at localhost/36263] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 16:03:34,803 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 16:03:34,889 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41173] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:34,917 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36967] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:35,041 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 16:03:35,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 16:03:35,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 16:03:35,063 INFO [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 16:03:35,063 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:35,064 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 16:03:35,064 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 16:03:35,065 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,065 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:35,066 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:35,066 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,066 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:35,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:35,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:35,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:35,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:35,067 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,067 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:35,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:35,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,068 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,068 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:03:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:03:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:03:35,068 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 16:03:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:35,069 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 16:03:35,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 16:03:35,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 16:03:35,071 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 16:03:35,071 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:35,071 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 16:03:35,072 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 16:03:35,072 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:35,073 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 16:03:35,074 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:35,074 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. started... 2023-02-13 16:03:35,074 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e1cc34bf8ae0ff6d80f568e3df8d51ac 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 16:03:35,075 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:35,075 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. started... 2023-02-13 16:03:35,075 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7e2fac213f0894558e0b6e83b1bc8199 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:35,075 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:35,075 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. started... 2023-02-13 16:03:35,075 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 16:03:35,075 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:35,075 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:35,075 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. started... 2023-02-13 16:03:35,075 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 16:03:35,076 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 16:03:35,076 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for f771c0f84d5513cee8c74cb9a669f3da: 2023-02-13 16:03:35,076 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:35,076 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. started... 2023-02-13 16:03:35,077 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b6ef70859660c5e71ec250c64943bdab 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:35,075 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 7d3679b4d7608731a817f64e86875cfe 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:35,075 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 16:03:35,076 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:35,080 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:35,080 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 16:03:35,075 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. started... 2023-02-13 16:03:35,080 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. started... 2023-02-13 16:03:35,081 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 74aaf39c3cb3d5ead7b8147b9fc28eaf 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:35,081 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing bf321661089a71e880fa4506d4b440a1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:35,155 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/.tmp/f1/8a2647d2307f4d73ae15844717939b72 2023-02-13 16:03:35,155 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/.tmp/f1/d7ea81c50c0847b1a936bd9f49ad6c93 2023-02-13 16:03:35,173 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/.tmp/f1/258b1b8b171c420fa1b46331cb9cbae0 2023-02-13 16:03:35,177 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/.tmp/f1/951038de4615412fb42769d1835786c4 2023-02-13 16:03:35,178 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/.tmp/f1/d2f3f77f862e4524b45739aec716030e 2023-02-13 16:03:35,187 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/.tmp/f1/f5cce8fc75e84f00822d47ca2dc5c578 2023-02-13 16:03:35,217 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/.tmp/f2/4a9405361fd54812bfb7f371fae2995d 2023-02-13 16:03:35,223 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/.tmp/f2/b630662676764752a1fb58b2f6cb1a88 2023-02-13 16:03:35,226 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/.tmp/f1/8a2647d2307f4d73ae15844717939b72 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/8a2647d2307f4d73ae15844717939b72 2023-02-13 16:03:35,232 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/.tmp/f2/0601e090e69842329d28fca5201f96c1 2023-02-13 16:03:35,232 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/.tmp/f1/d7ea81c50c0847b1a936bd9f49ad6c93 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/d7ea81c50c0847b1a936bd9f49ad6c93 2023-02-13 16:03:35,234 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/8a2647d2307f4d73ae15844717939b72, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:35,236 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/.tmp/f2/4a9405361fd54812bfb7f371fae2995d as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/4a9405361fd54812bfb7f371fae2995d 2023-02-13 16:03:35,240 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/.tmp/f1/258b1b8b171c420fa1b46331cb9cbae0 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/258b1b8b171c420fa1b46331cb9cbae0 2023-02-13 16:03:35,243 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/4a9405361fd54812bfb7f371fae2995d, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:35,245 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e1cc34bf8ae0ff6d80f568e3df8d51ac in 170ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:35,245 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e1cc34bf8ae0ff6d80f568e3df8d51ac: 2023-02-13 16:03:35,245 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:35,246 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/d7ea81c50c0847b1a936bd9f49ad6c93, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,247 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/.tmp/f2/b630662676764752a1fb58b2f6cb1a88 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/b630662676764752a1fb58b2f6cb1a88 2023-02-13 16:03:35,248 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/258b1b8b171c420fa1b46331cb9cbae0, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,248 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 16:03:35,249 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:35,249 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. started... 2023-02-13 16:03:35,249 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 15f5c1365441d7442a60654e2caee420 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 16:03:35,249 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/.tmp/f2/0601e090e69842329d28fca5201f96c1 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/0601e090e69842329d28fca5201f96c1 2023-02-13 16:03:35,260 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/.tmp/f2/b23cdfd19ae541678a90028b1fd927b1 2023-02-13 16:03:35,268 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/.tmp/f2/e723e95f07bb4576b290448ba5d249f9 2023-02-13 16:03:35,271 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/.tmp/f2/f8ed0e94947440fd9d3a97f79456be36 2023-02-13 16:03:35,273 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/b630662676764752a1fb58b2f6cb1a88, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,274 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7d3679b4d7608731a817f64e86875cfe in 199ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:35,274 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 7d3679b4d7608731a817f64e86875cfe: 2023-02-13 16:03:35,274 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:35,274 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:35,274 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/0601e090e69842329d28fca5201f96c1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,274 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 16:03:35,274 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. started... 2023-02-13 16:03:35,275 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 08b03f0c40004487390286d5ac7bc159 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:35,276 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 74aaf39c3cb3d5ead7b8147b9fc28eaf in 195ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:35,276 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 74aaf39c3cb3d5ead7b8147b9fc28eaf: 2023-02-13 16:03:35,276 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:35,276 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:35,276 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 16:03:35,277 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. started... 2023-02-13 16:03:35,277 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for cb76a17f03c6763538343ae979580d3f: 2023-02-13 16:03:35,277 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:35,277 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 16:03:35,280 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/.tmp/f1/951038de4615412fb42769d1835786c4 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/951038de4615412fb42769d1835786c4 2023-02-13 16:03:35,281 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/.tmp/f1/f5cce8fc75e84f00822d47ca2dc5c578 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/f5cce8fc75e84f00822d47ca2dc5c578 2023-02-13 16:03:35,286 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/951038de4615412fb42769d1835786c4, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,287 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/f5cce8fc75e84f00822d47ca2dc5c578, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,287 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/.tmp/f2/e723e95f07bb4576b290448ba5d249f9 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/e723e95f07bb4576b290448ba5d249f9 2023-02-13 16:03:35,288 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/.tmp/f2/b23cdfd19ae541678a90028b1fd927b1 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/b23cdfd19ae541678a90028b1fd927b1 2023-02-13 16:03:35,295 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/.tmp/f1/d2f3f77f862e4524b45739aec716030e as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/d2f3f77f862e4524b45739aec716030e 2023-02-13 16:03:35,295 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/e723e95f07bb4576b290448ba5d249f9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,297 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 7e2fac213f0894558e0b6e83b1bc8199 in 221ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:35,297 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7e2fac213f0894558e0b6e83b1bc8199: 2023-02-13 16:03:35,297 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:35,297 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 16:03:35,300 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/b23cdfd19ae541678a90028b1fd927b1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,301 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b6ef70859660c5e71ec250c64943bdab in 224ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:35,301 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b6ef70859660c5e71ec250c64943bdab: 2023-02-13 16:03:35,301 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:35,302 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 16:03:35,303 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/d2f3f77f862e4524b45739aec716030e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,304 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/.tmp/f2/f8ed0e94947440fd9d3a97f79456be36 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/f8ed0e94947440fd9d3a97f79456be36 2023-02-13 16:03:35,305 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/.tmp/f1/6260d6ae4ac345d4af3936e00806680a 2023-02-13 16:03:35,308 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/.tmp/f1/5a00469098614e3fa3ca40c0ac7daeee 2023-02-13 16:03:35,312 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/f8ed0e94947440fd9d3a97f79456be36, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,313 INFO [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for bf321661089a71e880fa4506d4b440a1 in 232ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:35,313 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for bf321661089a71e880fa4506d4b440a1: 2023-02-13 16:03:35,313 DEBUG [rs(jenkins-hbase4.apache.org,41173,1676304207946)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:35,313 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 16:03:35,313 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 16:03:35,313 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 16:03:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41173,1676304207946' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 16:03:35,318 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,318 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:35,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:35,319 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:35,319 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:35,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:35,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:35,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:35,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41173,1676304207946' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 16:03:35,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63c4b864[Count = 1] remaining members to acquire global barrier 2023-02-13 16:03:35,331 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/.tmp/f2/67e2d917cf274eca9518a6db721b393b 2023-02-13 16:03:35,334 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/.tmp/f2/9f239cc91ece44c4b49e95737b7291ff 2023-02-13 16:03:35,336 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-13 16:03:35,366 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/.tmp/f1/6260d6ae4ac345d4af3936e00806680a as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/6260d6ae4ac345d4af3936e00806680a 2023-02-13 16:03:35,369 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/.tmp/f1/5a00469098614e3fa3ca40c0ac7daeee as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/5a00469098614e3fa3ca40c0ac7daeee 2023-02-13 16:03:35,375 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/6260d6ae4ac345d4af3936e00806680a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:35,376 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/.tmp/f2/67e2d917cf274eca9518a6db721b393b as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/67e2d917cf274eca9518a6db721b393b 2023-02-13 16:03:35,379 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/5a00469098614e3fa3ca40c0ac7daeee, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,380 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/.tmp/f2/9f239cc91ece44c4b49e95737b7291ff as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/9f239cc91ece44c4b49e95737b7291ff 2023-02-13 16:03:35,389 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/67e2d917cf274eca9518a6db721b393b, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:35,390 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/9f239cc91ece44c4b49e95737b7291ff, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:35,391 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 15f5c1365441d7442a60654e2caee420 in 142ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:35,391 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 15f5c1365441d7442a60654e2caee420: 2023-02-13 16:03:35,391 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:35,391 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 16:03:35,391 INFO [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 08b03f0c40004487390286d5ac7bc159 in 116ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:35,391 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 08b03f0c40004487390286d5ac7bc159: 2023-02-13 16:03:35,391 DEBUG [rs(jenkins-hbase4.apache.org,36967,1676304208000)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:35,392 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 16:03:35,392 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 16:03:35,392 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,392 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 16:03:35,392 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36967,1676304208000' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 16:03:35,393 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,394 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:35,394 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:35,394 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:35,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:35,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:35,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:35,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36967,1676304208000' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 16:03:35,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63c4b864[Count = 0] remaining members to acquire global barrier 2023-02-13 16:03:35,397 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 16:03:35,397 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,399 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,399 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,399 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,399 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 16:03:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,399 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 16:03:35,399 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 16:03:35,400 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 16:03:35,400 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,41173,1676304207946' in zk 2023-02-13 16:03:35,399 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,36967,1676304208000' in zk 2023-02-13 16:03:35,400 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,400 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:03:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 16:03:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:35,402 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,402 DEBUG [member: 'jenkins-hbase4.apache.org,36967,1676304208000' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 16:03:35,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:35,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:35,403 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,403 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 16:03:35,404 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:35,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:35,404 DEBUG [member: 'jenkins-hbase4.apache.org,41173,1676304207946' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 16:03:35,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:35,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:35,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:35,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:35,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,36967,1676304208000': 2023-02-13 16:03:35,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36967,1676304208000' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-13 16:03:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:35,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:35,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:35,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:35,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:35,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,41173,1676304207946': 2023-02-13 16:03:35,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41173,1676304207946' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 16:03:35,414 INFO [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 16:03:35,414 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:03:35,414 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:03:35,414 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 16:03:35,414 INFO [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 16:03:35,417 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,417 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,417 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:35,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,417 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:35,417 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:35,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:35,418 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:35,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,419 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:35,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:35,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:35,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,424 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,424 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,431 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:35,431 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:35,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:35,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:35,431 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,432 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:35,432 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,432 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:35,432 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:35,433 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:35,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:35,433 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:35,433 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:35,433 DEBUG [(jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:35,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:35,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 16:03:35,433 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:35,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 16:03:35,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:35,433 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:35,435 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:35,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:35,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:35,436 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 16:03:35,436 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 16:03:35,446 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 16:03:35,448 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 16:03:35,537 DEBUG [Listener at localhost/36263] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 16:03:35,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 16:03:35,639 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/hadoop-277658617153181816.jar 2023-02-13 16:03:35,655 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676304212586 type: FLUSH version: 2 ttl: 0 2023-02-13 16:03:35,656 DEBUG [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce 2023-02-13 16:03:35,656 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:35,656 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(239): region to add: cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=7e2fac213f0894558e0b6e83b1bc8199 as 7e2fac213f0894558e0b6e83b1bc8199 in snapshot testWithMapReduceMultiRegion 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=f771c0f84d5513cee8c74cb9a669f3da as f771c0f84d5513cee8c74cb9a669f3da in snapshot testWithMapReduceMultiRegion 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=e1cc34bf8ae0ff6d80f568e3df8d51ac as e1cc34bf8ae0ff6d80f568e3df8d51ac in snapshot testWithMapReduceMultiRegion 2023-02-13 16:03:35,657 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=74aaf39c3cb3d5ead7b8147b9fc28eaf as 74aaf39c3cb3d5ead7b8147b9fc28eaf in snapshot testWithMapReduceMultiRegion 2023-02-13 16:03:35,658 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=7d3679b4d7608731a817f64e86875cfe as 7d3679b4d7608731a817f64e86875cfe in snapshot testWithMapReduceMultiRegion 2023-02-13 16:03:35,658 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=b6ef70859660c5e71ec250c64943bdab as b6ef70859660c5e71ec250c64943bdab in snapshot testWithMapReduceMultiRegion 2023-02-13 16:03:35,658 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=bf321661089a71e880fa4506d4b440a1 as bf321661089a71e880fa4506d4b440a1 in snapshot testWithMapReduceMultiRegion 2023-02-13 16:03:35,658 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=15f5c1365441d7442a60654e2caee420 as 15f5c1365441d7442a60654e2caee420 in snapshot testWithMapReduceMultiRegion 2023-02-13 16:03:35,658 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=08b03f0c40004487390286d5ac7bc159 as 08b03f0c40004487390286d5ac7bc159 in snapshot testWithMapReduceMultiRegion 2023-02-13 16:03:35,658 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(585): clone region=cb76a17f03c6763538343ae979580d3f as cb76a17f03c6763538343ae979580d3f in snapshot testWithMapReduceMultiRegion 2023-02-13 16:03:35,660 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7e2fac213f0894558e0b6e83b1bc8199, NAME => 'testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,661 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 7d3679b4d7608731a817f64e86875cfe, NAME => 'testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,662 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 74aaf39c3cb3d5ead7b8147b9fc28eaf, NAME => 'testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,662 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => e1cc34bf8ae0ff6d80f568e3df8d51ac, NAME => 'testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,662 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => f771c0f84d5513cee8c74cb9a669f3da, NAME => 'testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,662 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => b6ef70859660c5e71ec250c64943bdab, NAME => 'testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,662 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => bf321661089a71e880fa4506d4b440a1, NAME => 'testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,663 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 15f5c1365441d7442a60654e2caee420, NAME => 'testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,688 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:35,688 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 79f3d87d6ad0455691dbae34ecb41177 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,697 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c2597eade29a44868ef8377f5d629c6b from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,704 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:35,704 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d76a201d1a39417989deff4e30fba100 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,705 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:35,705 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 666c25bb365640cb95515df874935ed4 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,708 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing b6ef70859660c5e71ec250c64943bdab, disabling compactions & flushes 2023-02-13 16:03:35,708 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:35,708 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:35,708 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. after waiting 0 ms 2023-02-13 16:03:35,708 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:35,708 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:35,708 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for b6ef70859660c5e71ec250c64943bdab: Waiting for close lock at 1676304215708Disabling compacts and flushes for region at 1676304215708Disabling writes for close at 1676304215708Writing region close event to WAL at 1676304215708Closed at 1676304215708 2023-02-13 16:03:35,709 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 08b03f0c40004487390286d5ac7bc159, NAME => 'testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,710 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:35,711 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e4b2c2a8d8ca4271931450c90448cede from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,712 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:35,712 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c4d1eff3678744e2a8626ac9b942a5b6 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,722 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 83e5c2a2a0ff4f678ffac14168485930 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,722 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 98d8cb8f8fd2493f94e663ff24d9b139 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,722 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:35,723 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9423ed41c51d47d9bcf929df0cbfad9d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,726 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 32bf4aa95e4940208f4725964dfb7f94 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,728 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 06b894aee7a54f0fab09406bd77e03e2 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:35,729 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:35,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing f771c0f84d5513cee8c74cb9a669f3da, disabling compactions & flushes 2023-02-13 16:03:35,729 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 35fd86457970482aae6a8e05d7b2ea47 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,729 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:35,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:35,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. after waiting 0 ms 2023-02-13 16:03:35,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:35,729 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:35,729 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for f771c0f84d5513cee8c74cb9a669f3da: Waiting for close lock at 1676304215729Disabling compacts and flushes for region at 1676304215729Disabling writes for close at 1676304215729Writing region close event to WAL at 1676304215729Closed at 1676304215729 2023-02-13 16:03:35,730 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => cb76a17f03c6763538343ae979580d3f, NAME => 'testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,733 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f1d5969ba76f49219558bae0556fcb4d from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,733 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 7d3679b4d7608731a817f64e86875cfe, disabling compactions & flushes 2023-02-13 16:03:35,733 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:35,733 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:35,733 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. after waiting 0 ms 2023-02-13 16:03:35,734 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:35,734 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:35,734 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 7d3679b4d7608731a817f64e86875cfe: Waiting for close lock at 1676304215733Disabling compacts and flushes for region at 1676304215733Disabling writes for close at 1676304215734 (+1 ms)Writing region close event to WAL at 1676304215734Closed at 1676304215734 2023-02-13 16:03:35,736 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing e1cc34bf8ae0ff6d80f568e3df8d51ac, disabling compactions & flushes 2023-02-13 16:03:35,736 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink bc49fa2121264a66bd07d99d94a34e0e from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,736 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:35,736 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:35,736 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. after waiting 0 ms 2023-02-13 16:03:35,736 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:35,737 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:35,737 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for e1cc34bf8ae0ff6d80f568e3df8d51ac: Waiting for close lock at 1676304215736Disabling compacts and flushes for region at 1676304215736Disabling writes for close at 1676304215736Writing region close event to WAL at 1676304215736Closed at 1676304215736 2023-02-13 16:03:35,737 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing bf321661089a71e880fa4506d4b440a1, disabling compactions & flushes 2023-02-13 16:03:35,737 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:35,737 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:35,737 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. after waiting 0 ms 2023-02-13 16:03:35,737 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:35,737 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:35,737 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for bf321661089a71e880fa4506d4b440a1: Waiting for close lock at 1676304215737Disabling compacts and flushes for region at 1676304215737Disabling writes for close at 1676304215737Writing region close event to WAL at 1676304215737Closed at 1676304215737 2023-02-13 16:03:35,738 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 15f5c1365441d7442a60654e2caee420, disabling compactions & flushes 2023-02-13 16:03:35,738 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:35,738 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:35,738 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:35,738 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. after waiting 0 ms 2023-02-13 16:03:35,738 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c2cefe56945d484bb1bb6f9b6fe01fb7 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,738 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:35,738 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:35,738 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 15f5c1365441d7442a60654e2caee420: Waiting for close lock at 1676304215738Disabling compacts and flushes for region at 1676304215738Disabling writes for close at 1676304215738Writing region close event to WAL at 1676304215738Closed at 1676304215738 2023-02-13 16:03:35,742 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 74aaf39c3cb3d5ead7b8147b9fc28eaf, disabling compactions & flushes 2023-02-13 16:03:35,742 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:35,743 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:35,743 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. after waiting 0 ms 2023-02-13 16:03:35,743 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink d5c2df1227974d41abcd39805abf6d23 from cloned region in snapshot testWithMapReduceMultiRegion to table=testWithMapReduce 2023-02-13 16:03:35,743 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 7e2fac213f0894558e0b6e83b1bc8199, disabling compactions & flushes 2023-02-13 16:03:35,743 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:35,743 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:35,743 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:35,743 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 74aaf39c3cb3d5ead7b8147b9fc28eaf: Waiting for close lock at 1676304215742Disabling compacts and flushes for region at 1676304215742Disabling writes for close at 1676304215743 (+1 ms)Writing region close event to WAL at 1676304215743Closed at 1676304215743 2023-02-13 16:03:35,743 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:35,743 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. after waiting 0 ms 2023-02-13 16:03:35,744 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:35,744 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:35,744 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 7e2fac213f0894558e0b6e83b1bc8199: Waiting for close lock at 1676304215743Disabling compacts and flushes for region at 1676304215743Disabling writes for close at 1676304215744 (+1 ms)Writing region close event to WAL at 1676304215744Closed at 1676304215744 2023-02-13 16:03:35,744 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:35,745 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing cb76a17f03c6763538343ae979580d3f, disabling compactions & flushes 2023-02-13 16:03:35,745 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:35,745 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:35,745 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. after waiting 0 ms 2023-02-13 16:03:35,745 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:35,745 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:35,745 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for cb76a17f03c6763538343ae979580d3f: Waiting for close lock at 1676304215745Disabling compacts and flushes for region at 1676304215745Disabling writes for close at 1676304215745Writing region close event to WAL at 1676304215745Closed at 1676304215745 2023-02-13 16:03:35,745 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 08b03f0c40004487390286d5ac7bc159, disabling compactions & flushes 2023-02-13 16:03:35,745 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:35,745 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:35,745 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. after waiting 0 ms 2023-02-13 16:03:35,745 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:35,746 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:35,746 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 08b03f0c40004487390286d5ac7bc159: Waiting for close lock at 1676304215745Disabling compacts and flushes for region at 1676304215745Disabling writes for close at 1676304215745Writing region close event to WAL at 1676304215746 (+1 ms)Closed at 1676304215746 2023-02-13 16:03:35,746 INFO [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceMultiRegion" table: "testWithMapReduce" creation_time: 1676304212586 type: FLUSH version: 2 ttl: 0 2023-02-13 16:03:35,746 DEBUG [Listener at localhost/36263] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,746 DEBUG [Listener at localhost/36263] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc 2023-02-13 16:03:35,747 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-data/ 2023-02-13 16:03:35,747 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----default/ 2023-02-13 16:03:35,748 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 16:03:35,748 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------08b03f0c40004487390286d5ac7bc159/ 2023-02-13 16:03:35,749 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:35,749 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:35,749 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=08b03f0c40004487390286d5ac7bc159-c2cefe56945d484bb1bb6f9b6fe01fb7 2023-02-13 16:03:35,749 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:35,750 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=08b03f0c40004487390286d5ac7bc159-d5c2df1227974d41abcd39805abf6d23 2023-02-13 16:03:35,750 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------15f5c1365441d7442a60654e2caee420/ 2023-02-13 16:03:35,750 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:35,750 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:35,751 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=15f5c1365441d7442a60654e2caee420-666c25bb365640cb95515df874935ed4 2023-02-13 16:03:35,751 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:35,751 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=15f5c1365441d7442a60654e2caee420-98d8cb8f8fd2493f94e663ff24d9b139 2023-02-13 16:03:35,752 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------74aaf39c3cb3d5ead7b8147b9fc28eaf/ 2023-02-13 16:03:35,752 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:35,752 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:35,752 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=74aaf39c3cb3d5ead7b8147b9fc28eaf-9423ed41c51d47d9bcf929df0cbfad9d 2023-02-13 16:03:35,753 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:35,753 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=74aaf39c3cb3d5ead7b8147b9fc28eaf-f1d5969ba76f49219558bae0556fcb4d 2023-02-13 16:03:35,753 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------7d3679b4d7608731a817f64e86875cfe/ 2023-02-13 16:03:35,754 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:35,754 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:35,754 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=7d3679b4d7608731a817f64e86875cfe-d76a201d1a39417989deff4e30fba100 2023-02-13 16:03:35,754 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:35,754 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=7d3679b4d7608731a817f64e86875cfe-83e5c2a2a0ff4f678ffac14168485930 2023-02-13 16:03:35,755 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------7e2fac213f0894558e0b6e83b1bc8199/ 2023-02-13 16:03:35,755 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:35,755 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:35,756 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=7e2fac213f0894558e0b6e83b1bc8199-35fd86457970482aae6a8e05d7b2ea47 2023-02-13 16:03:35,756 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:35,756 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=7e2fac213f0894558e0b6e83b1bc8199-bc49fa2121264a66bd07d99d94a34e0e 2023-02-13 16:03:35,756 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------b6ef70859660c5e71ec250c64943bdab/ 2023-02-13 16:03:35,757 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:35,757 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:35,757 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=b6ef70859660c5e71ec250c64943bdab-79f3d87d6ad0455691dbae34ecb41177 2023-02-13 16:03:35,757 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:35,758 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=b6ef70859660c5e71ec250c64943bdab-c2597eade29a44868ef8377f5d629c6b 2023-02-13 16:03:35,758 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------bf321661089a71e880fa4506d4b440a1/ 2023-02-13 16:03:35,759 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:35,759 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:35,759 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=bf321661089a71e880fa4506d4b440a1-c4d1eff3678744e2a8626ac9b942a5b6 2023-02-13 16:03:35,759 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:35,760 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=bf321661089a71e880fa4506d4b440a1-06b894aee7a54f0fab09406bd77e03e2 2023-02-13 16:03:35,760 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------cb76a17f03c6763538343ae979580d3f/ 2023-02-13 16:03:35,760 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:35,760 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------e1cc34bf8ae0ff6d80f568e3df8d51ac/ 2023-02-13 16:03:35,761 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:35,761 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:35,761 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=e1cc34bf8ae0ff6d80f568e3df8d51ac-e4b2c2a8d8ca4271931450c90448cede 2023-02-13 16:03:35,762 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:35,762 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |----------------testWithMapReduce=e1cc34bf8ae0ff6d80f568e3df8d51ac-32bf4aa95e4940208f4725964dfb7f94 2023-02-13 16:03:35,762 DEBUG [Listener at localhost/36263] util.CommonFSUtils(699): |----------f771c0f84d5513cee8c74cb9a669f3da/ 2023-02-13 16:03:35,763 DEBUG [Listener at localhost/36263] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:35,771 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:35,772 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:35,772 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:35,772 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:36,657 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/hadoop-2802032033674819267.jar 2023-02-13 16:03:36,658 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:36,658 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:36,726 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/hadoop-7788501886373705193.jar 2023-02-13 16:03:36,726 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:36,727 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:36,727 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:36,728 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:36,728 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:36,729 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:36,729 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 16:03:36,730 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 16:03:36,730 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 16:03:36,731 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 16:03:36,731 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 16:03:36,732 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 16:03:36,733 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 16:03:36,733 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 16:03:36,734 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 16:03:36,735 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 16:03:36,741 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:36,742 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 16:03:36,742 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 16:03:36,742 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 16:03:36,743 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 16:03:36,810 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/hadoop-4645855215000193047.jar 2023-02-13 16:03:36,811 DEBUG [Listener at localhost/36263] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 16:03:36,860 WARN [Listener at localhost/36263] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 16:03:36,872 WARN [Listener at localhost/36263] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-13 16:03:36,888 INFO [Listener at localhost/36263] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 16:03:36,912 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 16:03:36,912 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 16:03:37,243 WARN [Listener at localhost/36263] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/mapreduce.cluster.local.dir/1676304217170/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 16:03:37,244 WARN [Listener at localhost/36263] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/mapreduce.cluster.local.dir/1676304217170/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 16:03:37,407 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:37,407 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:37,410 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:37,412 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:37,413 DEBUG [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1 2023-02-13 16:03:37,414 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08b03f0c40004487390286d5ac7bc159 columnFamilyName f1 2023-02-13 16:03:37,422 DEBUG [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/testWithMapReduce=08b03f0c40004487390286d5ac7bc159-c2cefe56945d484bb1bb6f9b6fe01fb7 2023-02-13 16:03:37,422 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] regionserver.HStore(310): Store=08b03f0c40004487390286d5ac7bc159/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:37,422 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:37,424 DEBUG [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2 2023-02-13 16:03:37,424 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 08b03f0c40004487390286d5ac7bc159 columnFamilyName f2 2023-02-13 16:03:37,429 DEBUG [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/testWithMapReduce=08b03f0c40004487390286d5ac7bc159-d5c2df1227974d41abcd39805abf6d23 2023-02-13 16:03:37,429 INFO [StoreOpener-08b03f0c40004487390286d5ac7bc159-1] regionserver.HStore(310): Store=08b03f0c40004487390286d5ac7bc159/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:37,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:37,430 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 08b03f0c40004487390286d5ac7bc159; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73018142, jitterRate=0.08805510401725769}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:37,430 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 08b03f0c40004487390286d5ac7bc159: Writing region info on filesystem at 1676304217410Initializing all the Stores at 1676304217411 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304217411Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304217411Region opened successfully at 1676304217430 (+19 ms) 2023-02-13 16:03:37,574 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 08b03f0c40004487390286d5ac7bc159, disabling compactions & flushes 2023-02-13 16:03:37,575 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:37,575 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:37,575 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. after waiting 0 ms 2023-02-13 16:03:37,575 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:37,581 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:37,581 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 08b03f0c40004487390286d5ac7bc159: Waiting for close lock at 1676304217574Disabling compacts and flushes for region at 1676304217574Disabling writes for close at 1676304217575 (+1 ms)Writing region close event to WAL at 1676304217581 (+6 ms)Closed at 1676304217581 2023-02-13 16:03:37,597 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:37,597 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:37,598 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:37,600 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:37,601 DEBUG [StoreOpener-15f5c1365441d7442a60654e2caee420-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1 2023-02-13 16:03:37,602 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15f5c1365441d7442a60654e2caee420 columnFamilyName f1 2023-02-13 16:03:37,609 DEBUG [StoreOpener-15f5c1365441d7442a60654e2caee420-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/testWithMapReduce=15f5c1365441d7442a60654e2caee420-666c25bb365640cb95515df874935ed4 2023-02-13 16:03:37,609 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] regionserver.HStore(310): Store=15f5c1365441d7442a60654e2caee420/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:37,609 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:37,610 DEBUG [StoreOpener-15f5c1365441d7442a60654e2caee420-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2 2023-02-13 16:03:37,610 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15f5c1365441d7442a60654e2caee420 columnFamilyName f2 2023-02-13 16:03:37,617 DEBUG [StoreOpener-15f5c1365441d7442a60654e2caee420-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/testWithMapReduce=15f5c1365441d7442a60654e2caee420-98d8cb8f8fd2493f94e663ff24d9b139 2023-02-13 16:03:37,617 INFO [StoreOpener-15f5c1365441d7442a60654e2caee420-1] regionserver.HStore(310): Store=15f5c1365441d7442a60654e2caee420/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:37,618 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:37,618 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 15f5c1365441d7442a60654e2caee420; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70035777, jitterRate=0.043614402413368225}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:37,618 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 15f5c1365441d7442a60654e2caee420: Writing region info on filesystem at 1676304217598Initializing all the Stores at 1676304217599 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304217599Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304217600 (+1 ms)Region opened successfully at 1676304217618 (+18 ms) 2023-02-13 16:03:37,674 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 15f5c1365441d7442a60654e2caee420, disabling compactions & flushes 2023-02-13 16:03:37,675 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:37,675 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:37,675 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. after waiting 0 ms 2023-02-13 16:03:37,675 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:37,679 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:37,679 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 15f5c1365441d7442a60654e2caee420: Waiting for close lock at 1676304217674Disabling compacts and flushes for region at 1676304217674Disabling writes for close at 1676304217675 (+1 ms)Writing region close event to WAL at 1676304217679 (+4 ms)Closed at 1676304217679 2023-02-13 16:03:37,686 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:37,686 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:37,688 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:37,693 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:37,694 DEBUG [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1 2023-02-13 16:03:37,695 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6ef70859660c5e71ec250c64943bdab columnFamilyName f1 2023-02-13 16:03:37,708 DEBUG [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/testWithMapReduce=b6ef70859660c5e71ec250c64943bdab-79f3d87d6ad0455691dbae34ecb41177 2023-02-13 16:03:37,708 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] regionserver.HStore(310): Store=b6ef70859660c5e71ec250c64943bdab/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:37,709 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:37,710 DEBUG [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2 2023-02-13 16:03:37,711 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b6ef70859660c5e71ec250c64943bdab columnFamilyName f2 2023-02-13 16:03:37,742 DEBUG [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/testWithMapReduce=b6ef70859660c5e71ec250c64943bdab-c2597eade29a44868ef8377f5d629c6b 2023-02-13 16:03:37,742 INFO [StoreOpener-b6ef70859660c5e71ec250c64943bdab-1] regionserver.HStore(310): Store=b6ef70859660c5e71ec250c64943bdab/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:37,743 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:37,744 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b6ef70859660c5e71ec250c64943bdab; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74712949, jitterRate=0.11330969631671906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:37,744 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b6ef70859660c5e71ec250c64943bdab: Writing region info on filesystem at 1676304217688Initializing all the Stores at 1676304217690 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304217690Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304217692 (+2 ms)Region opened successfully at 1676304217744 (+52 ms) 2023-02-13 16:03:37,864 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b6ef70859660c5e71ec250c64943bdab, disabling compactions & flushes 2023-02-13 16:03:37,865 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:37,865 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:37,865 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. after waiting 0 ms 2023-02-13 16:03:37,865 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:37,870 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:37,870 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b6ef70859660c5e71ec250c64943bdab: Waiting for close lock at 1676304217864Disabling compacts and flushes for region at 1676304217864Disabling writes for close at 1676304217865 (+1 ms)Writing region close event to WAL at 1676304217870 (+5 ms)Closed at 1676304217870 2023-02-13 16:03:37,875 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:37,875 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:37,880 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:37,889 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:37,891 DEBUG [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1 2023-02-13 16:03:37,891 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf321661089a71e880fa4506d4b440a1 columnFamilyName f1 2023-02-13 16:03:37,902 DEBUG [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/testWithMapReduce=bf321661089a71e880fa4506d4b440a1-c4d1eff3678744e2a8626ac9b942a5b6 2023-02-13 16:03:37,902 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] regionserver.HStore(310): Store=bf321661089a71e880fa4506d4b440a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:37,902 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:37,904 DEBUG [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2 2023-02-13 16:03:37,904 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf321661089a71e880fa4506d4b440a1 columnFamilyName f2 2023-02-13 16:03:37,913 DEBUG [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/testWithMapReduce=bf321661089a71e880fa4506d4b440a1-06b894aee7a54f0fab09406bd77e03e2 2023-02-13 16:03:37,913 INFO [StoreOpener-bf321661089a71e880fa4506d4b440a1-1] regionserver.HStore(310): Store=bf321661089a71e880fa4506d4b440a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:37,914 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:37,914 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bf321661089a71e880fa4506d4b440a1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74384629, jitterRate=0.10841734707355499}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:37,914 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bf321661089a71e880fa4506d4b440a1: Writing region info on filesystem at 1676304217880Initializing all the Stores at 1676304217883 (+3 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304217884 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304217888 (+4 ms)Region opened successfully at 1676304217914 (+26 ms) 2023-02-13 16:03:37,955 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bf321661089a71e880fa4506d4b440a1, disabling compactions & flushes 2023-02-13 16:03:37,955 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:37,956 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:37,956 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. after waiting 0 ms 2023-02-13 16:03:37,956 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:37,959 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:37,959 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bf321661089a71e880fa4506d4b440a1: Waiting for close lock at 1676304217955Disabling compacts and flushes for region at 1676304217955Disabling writes for close at 1676304217956 (+1 ms)Writing region close event to WAL at 1676304217959 (+3 ms)Closed at 1676304217959 2023-02-13 16:03:37,965 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:37,965 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:37,967 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:37,969 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:37,970 DEBUG [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1 2023-02-13 16:03:37,971 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74aaf39c3cb3d5ead7b8147b9fc28eaf columnFamilyName f1 2023-02-13 16:03:37,978 DEBUG [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/testWithMapReduce=74aaf39c3cb3d5ead7b8147b9fc28eaf-9423ed41c51d47d9bcf929df0cbfad9d 2023-02-13 16:03:37,979 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] regionserver.HStore(310): Store=74aaf39c3cb3d5ead7b8147b9fc28eaf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:37,979 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:37,980 DEBUG [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2 2023-02-13 16:03:37,980 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74aaf39c3cb3d5ead7b8147b9fc28eaf columnFamilyName f2 2023-02-13 16:03:37,989 DEBUG [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/testWithMapReduce=74aaf39c3cb3d5ead7b8147b9fc28eaf-f1d5969ba76f49219558bae0556fcb4d 2023-02-13 16:03:37,990 INFO [StoreOpener-74aaf39c3cb3d5ead7b8147b9fc28eaf-1] regionserver.HStore(310): Store=74aaf39c3cb3d5ead7b8147b9fc28eaf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:37,990 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:37,990 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 74aaf39c3cb3d5ead7b8147b9fc28eaf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71714340, jitterRate=0.06862694025039673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:37,990 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 74aaf39c3cb3d5ead7b8147b9fc28eaf: Writing region info on filesystem at 1676304217967Initializing all the Stores at 1676304217968 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304217968Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304217968Region opened successfully at 1676304217990 (+22 ms) 2023-02-13 16:03:38,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 74aaf39c3cb3d5ead7b8147b9fc28eaf, disabling compactions & flushes 2023-02-13 16:03:38,021 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:38,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:38,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. after waiting 0 ms 2023-02-13 16:03:38,021 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:38,024 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:38,025 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 74aaf39c3cb3d5ead7b8147b9fc28eaf: Waiting for close lock at 1676304218021Disabling compacts and flushes for region at 1676304218021Disabling writes for close at 1676304218021Writing region close event to WAL at 1676304218024 (+3 ms)Closed at 1676304218024 2023-02-13 16:03:38,031 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:38,031 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:38,032 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:38,036 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:38,038 DEBUG [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/f1 2023-02-13 16:03:38,039 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb76a17f03c6763538343ae979580d3f columnFamilyName f1 2023-02-13 16:03:38,040 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] regionserver.HStore(310): Store=cb76a17f03c6763538343ae979580d3f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:38,040 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:38,041 DEBUG [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/f2 2023-02-13 16:03:38,042 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb76a17f03c6763538343ae979580d3f columnFamilyName f2 2023-02-13 16:03:38,043 INFO [StoreOpener-cb76a17f03c6763538343ae979580d3f-1] regionserver.HStore(310): Store=cb76a17f03c6763538343ae979580d3f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:38,043 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:38,043 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened cb76a17f03c6763538343ae979580d3f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71384438, jitterRate=0.063711017370224}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:38,043 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for cb76a17f03c6763538343ae979580d3f: Writing region info on filesystem at 1676304218032Initializing all the Stores at 1676304218033 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304218033Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304218036 (+3 ms)Region opened successfully at 1676304218043 (+7 ms) 2023-02-13 16:03:38,063 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing cb76a17f03c6763538343ae979580d3f, disabling compactions & flushes 2023-02-13 16:03:38,063 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:38,063 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:38,063 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. after waiting 0 ms 2023-02-13 16:03:38,063 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:38,064 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:38,064 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for cb76a17f03c6763538343ae979580d3f: Waiting for close lock at 1676304218063Disabling compacts and flushes for region at 1676304218063Disabling writes for close at 1676304218063Writing region close event to WAL at 1676304218064 (+1 ms)Closed at 1676304218064 2023-02-13 16:03:38,071 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:38,071 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:38,080 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:38,083 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:38,085 DEBUG [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/f1 2023-02-13 16:03:38,086 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f771c0f84d5513cee8c74cb9a669f3da columnFamilyName f1 2023-02-13 16:03:38,087 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] regionserver.HStore(310): Store=f771c0f84d5513cee8c74cb9a669f3da/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:38,087 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:38,089 DEBUG [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/f2 2023-02-13 16:03:38,089 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f771c0f84d5513cee8c74cb9a669f3da columnFamilyName f2 2023-02-13 16:03:38,090 INFO [StoreOpener-f771c0f84d5513cee8c74cb9a669f3da-1] regionserver.HStore(310): Store=f771c0f84d5513cee8c74cb9a669f3da/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:38,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:38,090 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened f771c0f84d5513cee8c74cb9a669f3da; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61298560, jitterRate=-0.08658027648925781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:38,090 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for f771c0f84d5513cee8c74cb9a669f3da: Writing region info on filesystem at 1676304218080Initializing all the Stores at 1676304218082 (+2 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304218082Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304218082Region opened successfully at 1676304218090 (+8 ms) 2023-02-13 16:03:38,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing f771c0f84d5513cee8c74cb9a669f3da, disabling compactions & flushes 2023-02-13 16:03:38,125 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:38,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:38,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. after waiting 0 ms 2023-02-13 16:03:38,125 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:38,128 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:38,128 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for f771c0f84d5513cee8c74cb9a669f3da: Waiting for close lock at 1676304218125Disabling compacts and flushes for region at 1676304218125Disabling writes for close at 1676304218125Writing region close event to WAL at 1676304218128 (+3 ms)Closed at 1676304218128 2023-02-13 16:03:38,136 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:38,136 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:38,138 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:38,140 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:38,141 DEBUG [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1 2023-02-13 16:03:38,142 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1cc34bf8ae0ff6d80f568e3df8d51ac columnFamilyName f1 2023-02-13 16:03:38,148 DEBUG [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/testWithMapReduce=e1cc34bf8ae0ff6d80f568e3df8d51ac-e4b2c2a8d8ca4271931450c90448cede 2023-02-13 16:03:38,148 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] regionserver.HStore(310): Store=e1cc34bf8ae0ff6d80f568e3df8d51ac/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:38,148 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:38,149 DEBUG [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2 2023-02-13 16:03:38,150 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1cc34bf8ae0ff6d80f568e3df8d51ac columnFamilyName f2 2023-02-13 16:03:38,156 DEBUG [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/testWithMapReduce=e1cc34bf8ae0ff6d80f568e3df8d51ac-32bf4aa95e4940208f4725964dfb7f94 2023-02-13 16:03:38,156 INFO [StoreOpener-e1cc34bf8ae0ff6d80f568e3df8d51ac-1] regionserver.HStore(310): Store=e1cc34bf8ae0ff6d80f568e3df8d51ac/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:38,156 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:38,156 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened e1cc34bf8ae0ff6d80f568e3df8d51ac; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70067224, jitterRate=0.04408299922943115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:38,157 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for e1cc34bf8ae0ff6d80f568e3df8d51ac: Writing region info on filesystem at 1676304218138Initializing all the Stores at 1676304218139 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304218139Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304218139Region opened successfully at 1676304218157 (+18 ms) 2023-02-13 16:03:38,193 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing e1cc34bf8ae0ff6d80f568e3df8d51ac, disabling compactions & flushes 2023-02-13 16:03:38,194 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:38,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:38,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. after waiting 0 ms 2023-02-13 16:03:38,194 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:38,209 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:38,209 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for e1cc34bf8ae0ff6d80f568e3df8d51ac: Waiting for close lock at 1676304218193Disabling compacts and flushes for region at 1676304218193Disabling writes for close at 1676304218194 (+1 ms)Writing region close event to WAL at 1676304218209 (+15 ms)Closed at 1676304218209 2023-02-13 16:03:38,213 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:38,214 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:38,215 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:38,218 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:38,219 DEBUG [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1 2023-02-13 16:03:38,220 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e2fac213f0894558e0b6e83b1bc8199 columnFamilyName f1 2023-02-13 16:03:38,228 DEBUG [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/testWithMapReduce=7e2fac213f0894558e0b6e83b1bc8199-35fd86457970482aae6a8e05d7b2ea47 2023-02-13 16:03:38,229 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] regionserver.HStore(310): Store=7e2fac213f0894558e0b6e83b1bc8199/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:38,229 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:38,230 DEBUG [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2 2023-02-13 16:03:38,230 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e2fac213f0894558e0b6e83b1bc8199 columnFamilyName f2 2023-02-13 16:03:38,236 DEBUG [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/testWithMapReduce=7e2fac213f0894558e0b6e83b1bc8199-bc49fa2121264a66bd07d99d94a34e0e 2023-02-13 16:03:38,236 INFO [StoreOpener-7e2fac213f0894558e0b6e83b1bc8199-1] regionserver.HStore(310): Store=7e2fac213f0894558e0b6e83b1bc8199/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:38,236 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:38,236 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7e2fac213f0894558e0b6e83b1bc8199; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69883536, jitterRate=0.041345834732055664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:38,236 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7e2fac213f0894558e0b6e83b1bc8199: Writing region info on filesystem at 1676304218215Initializing all the Stores at 1676304218216 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304218217 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304218217Region opened successfully at 1676304218236 (+19 ms) 2023-02-13 16:03:38,267 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7e2fac213f0894558e0b6e83b1bc8199, disabling compactions & flushes 2023-02-13 16:03:38,267 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:38,267 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:38,267 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. after waiting 0 ms 2023-02-13 16:03:38,267 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:38,270 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:38,270 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7e2fac213f0894558e0b6e83b1bc8199: Waiting for close lock at 1676304218267Disabling compacts and flushes for region at 1676304218267Disabling writes for close at 1676304218267Writing region close event to WAL at 1676304218270 (+3 ms)Closed at 1676304218270 2023-02-13 16:03:38,275 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:38,275 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:38,276 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:38,280 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:38,282 DEBUG [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1 2023-02-13 16:03:38,282 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d3679b4d7608731a817f64e86875cfe columnFamilyName f1 2023-02-13 16:03:38,289 DEBUG [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/testWithMapReduce=7d3679b4d7608731a817f64e86875cfe-d76a201d1a39417989deff4e30fba100 2023-02-13 16:03:38,290 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] regionserver.HStore(310): Store=7d3679b4d7608731a817f64e86875cfe/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:38,290 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:38,291 DEBUG [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2 2023-02-13 16:03:38,291 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d3679b4d7608731a817f64e86875cfe columnFamilyName f2 2023-02-13 16:03:38,297 DEBUG [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] regionserver.HStore(539): loaded hdfs://localhost:36697/user/jenkins/test-data/f73a7321-5b89-4629-1565-7c9a40a006a7/testWithMapReduceMultiRegion/41412555-f86b-4cbd-8619-bd42218859dc/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/testWithMapReduce=7d3679b4d7608731a817f64e86875cfe-83e5c2a2a0ff4f678ffac14168485930 2023-02-13 16:03:38,297 INFO [StoreOpener-7d3679b4d7608731a817f64e86875cfe-1] regionserver.HStore(310): Store=7d3679b4d7608731a817f64e86875cfe/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:38,297 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:38,297 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 7d3679b4d7608731a817f64e86875cfe; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63405834, jitterRate=-0.055179446935653687}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:38,297 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 7d3679b4d7608731a817f64e86875cfe: Writing region info on filesystem at 1676304218276Initializing all the Stores at 1676304218277 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304218277Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304218280 (+3 ms)Region opened successfully at 1676304218297 (+17 ms) 2023-02-13 16:03:38,327 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 7d3679b4d7608731a817f64e86875cfe, disabling compactions & flushes 2023-02-13 16:03:38,327 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:38,328 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:38,328 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. after waiting 0 ms 2023-02-13 16:03:38,328 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:38,334 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:38,334 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 7d3679b4d7608731a817f64e86875cfe: Waiting for close lock at 1676304218327Disabling compacts and flushes for region at 1676304218327Disabling writes for close at 1676304218328 (+1 ms)Writing region close event to WAL at 1676304218334 (+6 ms)Closed at 1676304218334 2023-02-13 16:03:39,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceMultiRegion" 2023-02-13 16:03:39,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceMultiRegion 2023-02-13 16:03:39,344 INFO [Listener at localhost/36263] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 16:03:39,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 16:03:39,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-13 16:03:39,355 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304219354"}]},"ts":"1676304219354"} 2023-02-13 16:03:39,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 16:03:39,357 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-13 16:03:39,359 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-13 16:03:39,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f771c0f84d5513cee8c74cb9a669f3da, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e1cc34bf8ae0ff6d80f568e3df8d51ac, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=08b03f0c40004487390286d5ac7bc159, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bf321661089a71e880fa4506d4b440a1, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b6ef70859660c5e71ec250c64943bdab, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7e2fac213f0894558e0b6e83b1bc8199, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7d3679b4d7608731a817f64e86875cfe, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=74aaf39c3cb3d5ead7b8147b9fc28eaf, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=15f5c1365441d7442a60654e2caee420, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cb76a17f03c6763538343ae979580d3f, UNASSIGN}] 2023-02-13 16:03:39,365 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7d3679b4d7608731a817f64e86875cfe, UNASSIGN 2023-02-13 16:03:39,365 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b6ef70859660c5e71ec250c64943bdab, UNASSIGN 2023-02-13 16:03:39,366 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=bf321661089a71e880fa4506d4b440a1, UNASSIGN 2023-02-13 16:03:39,366 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=7e2fac213f0894558e0b6e83b1bc8199, UNASSIGN 2023-02-13 16:03:39,366 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=cb76a17f03c6763538343ae979580d3f, UNASSIGN 2023-02-13 16:03:39,367 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=7d3679b4d7608731a817f64e86875cfe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:39,367 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b6ef70859660c5e71ec250c64943bdab, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:39,367 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219366"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304219366"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304219366"}]},"ts":"1676304219366"} 2023-02-13 16:03:39,367 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219367"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304219367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304219367"}]},"ts":"1676304219367"} 2023-02-13 16:03:39,367 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=bf321661089a71e880fa4506d4b440a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:39,367 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=7e2fac213f0894558e0b6e83b1bc8199, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:39,367 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219367"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304219367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304219367"}]},"ts":"1676304219367"} 2023-02-13 16:03:39,367 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219367"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304219367"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304219367"}]},"ts":"1676304219367"} 2023-02-13 16:03:39,368 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=cb76a17f03c6763538343ae979580d3f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:39,369 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304219368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304219368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304219368"}]},"ts":"1676304219368"} 2023-02-13 16:03:39,370 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=40, state=RUNNABLE; CloseRegionProcedure 7d3679b4d7608731a817f64e86875cfe, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:39,373 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=38, state=RUNNABLE; CloseRegionProcedure b6ef70859660c5e71ec250c64943bdab, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:39,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=37, state=RUNNABLE; CloseRegionProcedure bf321661089a71e880fa4506d4b440a1, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:39,378 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=39, state=RUNNABLE; CloseRegionProcedure 7e2fac213f0894558e0b6e83b1bc8199, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:39,379 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure cb76a17f03c6763538343ae979580d3f, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:39,381 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=15f5c1365441d7442a60654e2caee420, UNASSIGN 2023-02-13 16:03:39,383 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=74aaf39c3cb3d5ead7b8147b9fc28eaf, UNASSIGN 2023-02-13 16:03:39,383 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=15f5c1365441d7442a60654e2caee420, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:39,383 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219383"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304219383"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304219383"}]},"ts":"1676304219383"} 2023-02-13 16:03:39,383 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=08b03f0c40004487390286d5ac7bc159, UNASSIGN 2023-02-13 16:03:39,385 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=74aaf39c3cb3d5ead7b8147b9fc28eaf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:39,385 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304219385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304219385"}]},"ts":"1676304219385"} 2023-02-13 16:03:39,385 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=e1cc34bf8ae0ff6d80f568e3df8d51ac, UNASSIGN 2023-02-13 16:03:39,387 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=08b03f0c40004487390286d5ac7bc159, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:39,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 15f5c1365441d7442a60654e2caee420, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:39,387 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304219387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304219387"}]},"ts":"1676304219387"} 2023-02-13 16:03:39,387 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=f771c0f84d5513cee8c74cb9a669f3da, UNASSIGN 2023-02-13 16:03:39,388 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e1cc34bf8ae0ff6d80f568e3df8d51ac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:39,388 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219388"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304219388"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304219388"}]},"ts":"1676304219388"} 2023-02-13 16:03:39,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure 74aaf39c3cb3d5ead7b8147b9fc28eaf, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:39,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=36, state=RUNNABLE; CloseRegionProcedure 08b03f0c40004487390286d5ac7bc159, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:39,390 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=f771c0f84d5513cee8c74cb9a669f3da, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:39,390 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304219390"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304219390"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304219390"}]},"ts":"1676304219390"} 2023-02-13 16:03:39,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=35, state=RUNNABLE; CloseRegionProcedure e1cc34bf8ae0ff6d80f568e3df8d51ac, server=jenkins-hbase4.apache.org,36967,1676304208000}] 2023-02-13 16:03:39,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=34, state=RUNNABLE; CloseRegionProcedure f771c0f84d5513cee8c74cb9a669f3da, server=jenkins-hbase4.apache.org,41173,1676304207946}] 2023-02-13 16:03:39,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 16:03:39,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:39,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:39,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bf321661089a71e880fa4506d4b440a1, disabling compactions & flushes 2023-02-13 16:03:39,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b6ef70859660c5e71ec250c64943bdab, disabling compactions & flushes 2023-02-13 16:03:39,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:39,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:39,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:39,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:39,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. after waiting 0 ms 2023-02-13 16:03:39,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:39,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. after waiting 0 ms 2023-02-13 16:03:39,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:39,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:39,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:39,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1. 2023-02-13 16:03:39,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab. 2023-02-13 16:03:39,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bf321661089a71e880fa4506d4b440a1: Waiting for close lock at 1676304219533Running coprocessor pre-close hooks at 1676304219533Disabling compacts and flushes for region at 1676304219533Disabling writes for close at 1676304219533Writing region close event to WAL at 1676304219545 (+12 ms)Running coprocessor post-close hooks at 1676304219557 (+12 ms)Closed at 1676304219558 (+1 ms) 2023-02-13 16:03:39,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b6ef70859660c5e71ec250c64943bdab: Waiting for close lock at 1676304219533Running coprocessor pre-close hooks at 1676304219533Disabling compacts and flushes for region at 1676304219533Disabling writes for close at 1676304219533Writing region close event to WAL at 1676304219542 (+9 ms)Running coprocessor post-close hooks at 1676304219558 (+16 ms)Closed at 1676304219559 (+1 ms) 2023-02-13 16:03:39,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:39,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:39,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing f771c0f84d5513cee8c74cb9a669f3da, disabling compactions & flushes 2023-02-13 16:03:39,562 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:39,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:39,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. after waiting 0 ms 2023-02-13 16:03:39,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:39,563 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=bf321661089a71e880fa4506d4b440a1, regionState=CLOSED 2023-02-13 16:03:39,563 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219563"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304219563"}]},"ts":"1676304219563"} 2023-02-13 16:03:39,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:39,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:39,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7d3679b4d7608731a817f64e86875cfe, disabling compactions & flushes 2023-02-13 16:03:39,564 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:39,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:39,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. after waiting 0 ms 2023-02-13 16:03:39,564 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:39,565 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=b6ef70859660c5e71ec250c64943bdab, regionState=CLOSED 2023-02-13 16:03:39,565 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219565"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304219565"}]},"ts":"1676304219565"} 2023-02-13 16:03:39,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=37 2023-02-13 16:03:39,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=37, state=SUCCESS; CloseRegionProcedure bf321661089a71e880fa4506d4b440a1, server=jenkins-hbase4.apache.org,41173,1676304207946 in 188 msec 2023-02-13 16:03:39,571 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bf321661089a71e880fa4506d4b440a1, UNASSIGN in 207 msec 2023-02-13 16:03:39,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=38 2023-02-13 16:03:39,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=38, state=SUCCESS; CloseRegionProcedure b6ef70859660c5e71ec250c64943bdab, server=jenkins-hbase4.apache.org,36967,1676304208000 in 194 msec 2023-02-13 16:03:39,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b6ef70859660c5e71ec250c64943bdab, UNASSIGN in 210 msec 2023-02-13 16:03:39,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 16:03:39,584 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da. 2023-02-13 16:03:39,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for f771c0f84d5513cee8c74cb9a669f3da: Waiting for close lock at 1676304219562Running coprocessor pre-close hooks at 1676304219562Disabling compacts and flushes for region at 1676304219562Disabling writes for close at 1676304219562Writing region close event to WAL at 1676304219572 (+10 ms)Running coprocessor post-close hooks at 1676304219583 (+11 ms)Closed at 1676304219584 (+1 ms) 2023-02-13 16:03:39,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:39,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:39,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7e2fac213f0894558e0b6e83b1bc8199, disabling compactions & flushes 2023-02-13 16:03:39,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:39,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:39,587 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=f771c0f84d5513cee8c74cb9a669f3da, regionState=CLOSED 2023-02-13 16:03:39,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:39,587 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304219587"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304219587"}]},"ts":"1676304219587"} 2023-02-13 16:03:39,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. after waiting 0 ms 2023-02-13 16:03:39,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:39,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe. 2023-02-13 16:03:39,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7d3679b4d7608731a817f64e86875cfe: Waiting for close lock at 1676304219564Running coprocessor pre-close hooks at 1676304219564Disabling compacts and flushes for region at 1676304219564Disabling writes for close at 1676304219564Writing region close event to WAL at 1676304219581 (+17 ms)Running coprocessor post-close hooks at 1676304219587 (+6 ms)Closed at 1676304219588 (+1 ms) 2023-02-13 16:03:39,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:39,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:39,621 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=7d3679b4d7608731a817f64e86875cfe, regionState=CLOSED 2023-02-13 16:03:39,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e1cc34bf8ae0ff6d80f568e3df8d51ac, disabling compactions & flushes 2023-02-13 16:03:39,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:39,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:39,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. after waiting 0 ms 2023-02-13 16:03:39,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:39,621 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219620"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304219620"}]},"ts":"1676304219620"} 2023-02-13 16:03:39,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=34 2023-02-13 16:03:39,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=34, state=SUCCESS; CloseRegionProcedure f771c0f84d5513cee8c74cb9a669f3da, server=jenkins-hbase4.apache.org,41173,1676304207946 in 197 msec 2023-02-13 16:03:39,641 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=f771c0f84d5513cee8c74cb9a669f3da, UNASSIGN in 273 msec 2023-02-13 16:03:39,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=40 2023-02-13 16:03:39,642 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=40, state=SUCCESS; CloseRegionProcedure 7d3679b4d7608731a817f64e86875cfe, server=jenkins-hbase4.apache.org,36967,1676304208000 in 266 msec 2023-02-13 16:03:39,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7d3679b4d7608731a817f64e86875cfe, UNASSIGN in 281 msec 2023-02-13 16:03:39,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 16:03:39,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:39,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199. 2023-02-13 16:03:39,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:39,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7e2fac213f0894558e0b6e83b1bc8199: Waiting for close lock at 1676304219586Running coprocessor pre-close hooks at 1676304219586Disabling compacts and flushes for region at 1676304219586Disabling writes for close at 1676304219587 (+1 ms)Writing region close event to WAL at 1676304219651 (+64 ms)Running coprocessor post-close hooks at 1676304219665 (+14 ms)Closed at 1676304219665 2023-02-13 16:03:39,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac. 2023-02-13 16:03:39,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e1cc34bf8ae0ff6d80f568e3df8d51ac: Waiting for close lock at 1676304219621Running coprocessor pre-close hooks at 1676304219621Disabling compacts and flushes for region at 1676304219621Disabling writes for close at 1676304219621Writing region close event to WAL at 1676304219649 (+28 ms)Running coprocessor post-close hooks at 1676304219666 (+17 ms)Closed at 1676304219667 (+1 ms) 2023-02-13 16:03:39,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:39,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:39,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 74aaf39c3cb3d5ead7b8147b9fc28eaf, disabling compactions & flushes 2023-02-13 16:03:39,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:39,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:39,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. after waiting 0 ms 2023-02-13 16:03:39,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:39,670 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=7e2fac213f0894558e0b6e83b1bc8199, regionState=CLOSED 2023-02-13 16:03:39,670 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304219670"}]},"ts":"1676304219670"} 2023-02-13 16:03:39,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:39,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:39,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 15f5c1365441d7442a60654e2caee420, disabling compactions & flushes 2023-02-13 16:03:39,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:39,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:39,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. after waiting 0 ms 2023-02-13 16:03:39,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:39,671 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e1cc34bf8ae0ff6d80f568e3df8d51ac, regionState=CLOSED 2023-02-13 16:03:39,671 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304219671"}]},"ts":"1676304219671"} 2023-02-13 16:03:39,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=39 2023-02-13 16:03:39,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=39, state=SUCCESS; CloseRegionProcedure 7e2fac213f0894558e0b6e83b1bc8199, server=jenkins-hbase4.apache.org,41173,1676304207946 in 294 msec 2023-02-13 16:03:39,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=35 2023-02-13 16:03:39,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=35, state=SUCCESS; CloseRegionProcedure e1cc34bf8ae0ff6d80f568e3df8d51ac, server=jenkins-hbase4.apache.org,36967,1676304208000 in 283 msec 2023-02-13 16:03:39,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=7e2fac213f0894558e0b6e83b1bc8199, UNASSIGN in 314 msec 2023-02-13 16:03:39,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=e1cc34bf8ae0ff6d80f568e3df8d51ac, UNASSIGN in 316 msec 2023-02-13 16:03:39,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:39,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf. 2023-02-13 16:03:39,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 74aaf39c3cb3d5ead7b8147b9fc28eaf: Waiting for close lock at 1676304219669Running coprocessor pre-close hooks at 1676304219669Disabling compacts and flushes for region at 1676304219669Disabling writes for close at 1676304219669Writing region close event to WAL at 1676304219680 (+11 ms)Running coprocessor post-close hooks at 1676304219691 (+11 ms)Closed at 1676304219691 2023-02-13 16:03:39,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:39,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:39,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing cb76a17f03c6763538343ae979580d3f, disabling compactions & flushes 2023-02-13 16:03:39,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:39,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:39,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. after waiting 0 ms 2023-02-13 16:03:39,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:39,695 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=74aaf39c3cb3d5ead7b8147b9fc28eaf, regionState=CLOSED 2023-02-13 16:03:39,695 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219695"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304219695"}]},"ts":"1676304219695"} 2023-02-13 16:03:39,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-13 16:03:39,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure 74aaf39c3cb3d5ead7b8147b9fc28eaf, server=jenkins-hbase4.apache.org,41173,1676304207946 in 309 msec 2023-02-13 16:03:39,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=74aaf39c3cb3d5ead7b8147b9fc28eaf, UNASSIGN in 339 msec 2023-02-13 16:03:39,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:39,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420. 2023-02-13 16:03:39,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 15f5c1365441d7442a60654e2caee420: Waiting for close lock at 1676304219670Running coprocessor pre-close hooks at 1676304219670Disabling compacts and flushes for region at 1676304219670Disabling writes for close at 1676304219670Writing region close event to WAL at 1676304219688 (+18 ms)Running coprocessor post-close hooks at 1676304219704 (+16 ms)Closed at 1676304219705 (+1 ms) 2023-02-13 16:03:39,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:39,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:39,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 08b03f0c40004487390286d5ac7bc159, disabling compactions & flushes 2023-02-13 16:03:39,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:39,708 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=15f5c1365441d7442a60654e2caee420, regionState=CLOSED 2023-02-13 16:03:39,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:39,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. after waiting 0 ms 2023-02-13 16:03:39,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:39,708 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219708"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304219708"}]},"ts":"1676304219708"} 2023-02-13 16:03:39,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-13 16:03:39,717 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 15f5c1365441d7442a60654e2caee420, server=jenkins-hbase4.apache.org,36967,1676304208000 in 323 msec 2023-02-13 16:03:39,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 16:03:39,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=15f5c1365441d7442a60654e2caee420, UNASSIGN in 353 msec 2023-02-13 16:03:39,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f. 2023-02-13 16:03:39,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for cb76a17f03c6763538343ae979580d3f: Waiting for close lock at 1676304219694Running coprocessor pre-close hooks at 1676304219694Disabling compacts and flushes for region at 1676304219694Disabling writes for close at 1676304219694Writing region close event to WAL at 1676304219703 (+9 ms)Running coprocessor post-close hooks at 1676304219719 (+16 ms)Closed at 1676304219720 (+1 ms) 2023-02-13 16:03:39,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:39,723 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=cb76a17f03c6763538343ae979580d3f, regionState=CLOSED 2023-02-13 16:03:39,724 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304219723"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304219723"}]},"ts":"1676304219723"} 2023-02-13 16:03:39,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:39,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159. 2023-02-13 16:03:39,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 08b03f0c40004487390286d5ac7bc159: Waiting for close lock at 1676304219708Running coprocessor pre-close hooks at 1676304219708Disabling compacts and flushes for region at 1676304219708Disabling writes for close at 1676304219708Writing region close event to WAL at 1676304219719 (+11 ms)Running coprocessor post-close hooks at 1676304219725 (+6 ms)Closed at 1676304219726 (+1 ms) 2023-02-13 16:03:39,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:39,729 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=08b03f0c40004487390286d5ac7bc159, regionState=CLOSED 2023-02-13 16:03:39,729 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304219729"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304219729"}]},"ts":"1676304219729"} 2023-02-13 16:03:39,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-13 16:03:39,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure cb76a17f03c6763538343ae979580d3f, server=jenkins-hbase4.apache.org,41173,1676304207946 in 347 msec 2023-02-13 16:03:39,736 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=cb76a17f03c6763538343ae979580d3f, UNASSIGN in 371 msec 2023-02-13 16:03:39,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=36 2023-02-13 16:03:39,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=36, state=SUCCESS; CloseRegionProcedure 08b03f0c40004487390286d5ac7bc159, server=jenkins-hbase4.apache.org,36967,1676304208000 in 345 msec 2023-02-13 16:03:39,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=33 2023-02-13 16:03:39,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=08b03f0c40004487390286d5ac7bc159, UNASSIGN in 376 msec 2023-02-13 16:03:39,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304219740"}]},"ts":"1676304219740"} 2023-02-13 16:03:39,742 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-13 16:03:39,745 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-13 16:03:39,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 401 msec 2023-02-13 16:03:39,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 16:03:39,964 INFO [Listener at localhost/36263] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 33 completed 2023-02-13 16:03:39,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-13 16:03:39,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:03:39,982 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:03:39,984 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:03:39,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 16:03:40,002 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:40,002 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:40,003 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:40,003 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:40,003 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:40,002 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:40,002 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:40,003 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:40,011 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/f1, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/f2, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/recovered.edits] 2023-02-13 16:03:40,012 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/recovered.edits] 2023-02-13 16:03:40,012 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/recovered.edits] 2023-02-13 16:03:40,012 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/recovered.edits] 2023-02-13 16:03:40,012 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/recovered.edits] 2023-02-13 16:03:40,013 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/recovered.edits] 2023-02-13 16:03:40,014 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/recovered.edits] 2023-02-13 16:03:40,014 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/recovered.edits] 2023-02-13 16:03:40,034 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/258b1b8b171c420fa1b46331cb9cbae0 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/258b1b8b171c420fa1b46331cb9cbae0 2023-02-13 16:03:40,034 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/d76a201d1a39417989deff4e30fba100 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/d76a201d1a39417989deff4e30fba100 2023-02-13 16:03:40,034 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/79f3d87d6ad0455691dbae34ecb41177 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/79f3d87d6ad0455691dbae34ecb41177 2023-02-13 16:03:40,035 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/c4d1eff3678744e2a8626ac9b942a5b6 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/c4d1eff3678744e2a8626ac9b942a5b6 2023-02-13 16:03:40,035 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/8a2647d2307f4d73ae15844717939b72 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/8a2647d2307f4d73ae15844717939b72 2023-02-13 16:03:40,036 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/35fd86457970482aae6a8e05d7b2ea47 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/35fd86457970482aae6a8e05d7b2ea47 2023-02-13 16:03:40,037 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/5a00469098614e3fa3ca40c0ac7daeee to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/5a00469098614e3fa3ca40c0ac7daeee 2023-02-13 16:03:40,042 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/9423ed41c51d47d9bcf929df0cbfad9d to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f1/9423ed41c51d47d9bcf929df0cbfad9d 2023-02-13 16:03:40,042 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/f5cce8fc75e84f00822d47ca2dc5c578 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f1/f5cce8fc75e84f00822d47ca2dc5c578 2023-02-13 16:03:40,042 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/e4b2c2a8d8ca4271931450c90448cede to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f1/e4b2c2a8d8ca4271931450c90448cede 2023-02-13 16:03:40,042 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/d7ea81c50c0847b1a936bd9f49ad6c93 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f1/d7ea81c50c0847b1a936bd9f49ad6c93 2023-02-13 16:03:40,044 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/d2f3f77f862e4524b45739aec716030e to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f1/d2f3f77f862e4524b45739aec716030e 2023-02-13 16:03:40,045 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/c2cefe56945d484bb1bb6f9b6fe01fb7 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f1/c2cefe56945d484bb1bb6f9b6fe01fb7 2023-02-13 16:03:40,045 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/951038de4615412fb42769d1835786c4 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f1/951038de4615412fb42769d1835786c4 2023-02-13 16:03:40,046 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/recovered.edits/6.seqid to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da/recovered.edits/6.seqid 2023-02-13 16:03:40,049 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/f771c0f84d5513cee8c74cb9a669f3da 2023-02-13 16:03:40,049 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:40,056 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/b23cdfd19ae541678a90028b1fd927b1 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/b23cdfd19ae541678a90028b1fd927b1 2023-02-13 16:03:40,056 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/32bf4aa95e4940208f4725964dfb7f94 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/32bf4aa95e4940208f4725964dfb7f94 2023-02-13 16:03:40,058 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/recovered.edits] 2023-02-13 16:03:40,058 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/9f239cc91ece44c4b49e95737b7291ff to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/9f239cc91ece44c4b49e95737b7291ff 2023-02-13 16:03:40,059 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/bc49fa2121264a66bd07d99d94a34e0e to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/bc49fa2121264a66bd07d99d94a34e0e 2023-02-13 16:03:40,059 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/83e5c2a2a0ff4f678ffac14168485930 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/83e5c2a2a0ff4f678ffac14168485930 2023-02-13 16:03:40,059 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/0601e090e69842329d28fca5201f96c1 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/0601e090e69842329d28fca5201f96c1 2023-02-13 16:03:40,060 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/c2597eade29a44868ef8377f5d629c6b to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/f2/c2597eade29a44868ef8377f5d629c6b 2023-02-13 16:03:40,060 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/06b894aee7a54f0fab09406bd77e03e2 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/06b894aee7a54f0fab09406bd77e03e2 2023-02-13 16:03:40,060 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/4a9405361fd54812bfb7f371fae2995d to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/f2/4a9405361fd54812bfb7f371fae2995d 2023-02-13 16:03:40,061 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/d5c2df1227974d41abcd39805abf6d23 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/f2/d5c2df1227974d41abcd39805abf6d23 2023-02-13 16:03:40,062 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/e723e95f07bb4576b290448ba5d249f9 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/f2/e723e95f07bb4576b290448ba5d249f9 2023-02-13 16:03:40,063 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/f1d5969ba76f49219558bae0556fcb4d to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/f2/f1d5969ba76f49219558bae0556fcb4d 2023-02-13 16:03:40,063 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/f8ed0e94947440fd9d3a97f79456be36 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/f2/f8ed0e94947440fd9d3a97f79456be36 2023-02-13 16:03:40,063 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/b630662676764752a1fb58b2f6cb1a88 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/f2/b630662676764752a1fb58b2f6cb1a88 2023-02-13 16:03:40,067 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/recovered.edits/12.seqid to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab/recovered.edits/12.seqid 2023-02-13 16:03:40,068 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/6260d6ae4ac345d4af3936e00806680a to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/6260d6ae4ac345d4af3936e00806680a 2023-02-13 16:03:40,069 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/b6ef70859660c5e71ec250c64943bdab 2023-02-13 16:03:40,069 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:40,070 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/recovered.edits/12.seqid to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199/recovered.edits/12.seqid 2023-02-13 16:03:40,070 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/recovered.edits/12.seqid to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe/recovered.edits/12.seqid 2023-02-13 16:03:40,071 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/recovered.edits/12.seqid to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac/recovered.edits/12.seqid 2023-02-13 16:03:40,071 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/recovered.edits/12.seqid to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159/recovered.edits/12.seqid 2023-02-13 16:03:40,071 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7e2fac213f0894558e0b6e83b1bc8199 2023-02-13 16:03:40,072 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/7d3679b4d7608731a817f64e86875cfe 2023-02-13 16:03:40,072 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/e1cc34bf8ae0ff6d80f568e3df8d51ac 2023-02-13 16:03:40,072 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/08b03f0c40004487390286d5ac7bc159 2023-02-13 16:03:40,073 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/f1, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/f2, FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/recovered.edits] 2023-02-13 16:03:40,076 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/recovered.edits/12.seqid to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf/recovered.edits/12.seqid 2023-02-13 16:03:40,076 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/recovered.edits/12.seqid to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1/recovered.edits/12.seqid 2023-02-13 16:03:40,076 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/666c25bb365640cb95515df874935ed4 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f1/666c25bb365640cb95515df874935ed4 2023-02-13 16:03:40,077 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/74aaf39c3cb3d5ead7b8147b9fc28eaf 2023-02-13 16:03:40,077 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/bf321661089a71e880fa4506d4b440a1 2023-02-13 16:03:40,081 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/67e2d917cf274eca9518a6db721b393b to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/67e2d917cf274eca9518a6db721b393b 2023-02-13 16:03:40,082 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/98d8cb8f8fd2493f94e663ff24d9b139 to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/f2/98d8cb8f8fd2493f94e663ff24d9b139 2023-02-13 16:03:40,083 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/recovered.edits/6.seqid to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f/recovered.edits/6.seqid 2023-02-13 16:03:40,085 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/cb76a17f03c6763538343ae979580d3f 2023-02-13 16:03:40,087 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/recovered.edits/12.seqid to hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/archive/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420/recovered.edits/12.seqid 2023-02-13 16:03:40,087 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/.tmp/data/default/testWithMapReduce/15f5c1365441d7442a60654e2caee420 2023-02-13 16:03:40,087 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 16:03:40,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 16:03:40,091 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:03:40,116 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMapReduce from hbase:meta 2023-02-13 16:03:40,122 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-13 16:03:40,124 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:03:40,124 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-13 16:03:40,124 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304220124"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,124 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304220124"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,124 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,d\\x84\\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304220124"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,124 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,g\\xA7\\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304220124"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,125 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,j\\xCA\\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304220124"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,125 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,m\\xED\\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304220124"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,125 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,q\\x11\\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304220124"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,125 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304220124"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,125 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304220124"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,125 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304220124"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,127 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-13 16:03:40,128 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f771c0f84d5513cee8c74cb9a669f3da, NAME => 'testWithMapReduce,,1676304210851.f771c0f84d5513cee8c74cb9a669f3da.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => e1cc34bf8ae0ff6d80f568e3df8d51ac, NAME => 'testWithMapReduce,aaa,1676304210851.e1cc34bf8ae0ff6d80f568e3df8d51ac.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => 08b03f0c40004487390286d5ac7bc159, NAME => 'testWithMapReduce,d\x84\x84,1676304210851.08b03f0c40004487390286d5ac7bc159.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => bf321661089a71e880fa4506d4b440a1, NAME => 'testWithMapReduce,g\xA7\xA7,1676304210851.bf321661089a71e880fa4506d4b440a1.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => b6ef70859660c5e71ec250c64943bdab, NAME => 'testWithMapReduce,j\xCA\xCA,1676304210851.b6ef70859660c5e71ec250c64943bdab.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 7e2fac213f0894558e0b6e83b1bc8199, NAME => 'testWithMapReduce,m\xED\xED,1676304210851.7e2fac213f0894558e0b6e83b1bc8199.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 7d3679b4d7608731a817f64e86875cfe, NAME => 'testWithMapReduce,q\x11\x10,1676304210851.7d3679b4d7608731a817f64e86875cfe.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => 74aaf39c3cb3d5ead7b8147b9fc28eaf, NAME => 'testWithMapReduce,t43,1676304210851.74aaf39c3cb3d5ead7b8147b9fc28eaf.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 15f5c1365441d7442a60654e2caee420, NAME => 'testWithMapReduce,wWV,1676304210851.15f5c1365441d7442a60654e2caee420.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => cb76a17f03c6763538343ae979580d3f, NAME => 'testWithMapReduce,zz{,1676304210851.cb76a17f03c6763538343ae979580d3f.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-13 16:03:40,128 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-13 16:03:40,128 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676304220128"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:40,130 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-13 16:03:40,132 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:03:40,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 160 msec 2023-02-13 16:03:40,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35105] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 16:03:40,291 INFO [Listener at localhost/36263] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 54 completed 2023-02-13 16:03:40,291 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 16:03:40,291 INFO [Listener at localhost/36263] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 16:03:40,291 DEBUG [Listener at localhost/36263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4849a610 to 127.0.0.1:64487 2023-02-13 16:03:40,291 DEBUG [Listener at localhost/36263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:40,291 DEBUG [Listener at localhost/36263] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 16:03:40,292 DEBUG [Listener at localhost/36263] util.JVMClusterUtil(257): Found active master hash=694402305, stopped=false 2023-02-13 16:03:40,292 INFO [Listener at localhost/36263] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35105,1676304206758 2023-02-13 16:03:40,294 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:40,294 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:40,294 INFO [Listener at localhost/36263] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 16:03:40,294 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:40,295 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:40,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:40,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:40,299 DEBUG [Listener at localhost/36263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c09efab to 127.0.0.1:64487 2023-02-13 16:03:40,299 DEBUG [Listener at localhost/36263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:40,300 INFO [Listener at localhost/36263] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41173,1676304207946' ***** 2023-02-13 16:03:40,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:40,300 INFO [Listener at localhost/36263] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:03:40,300 INFO [Listener at localhost/36263] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36967,1676304208000' ***** 2023-02-13 16:03:40,300 INFO [Listener at localhost/36263] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:03:40,300 INFO [RS:0;jenkins-hbase4:41173] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:03:40,300 INFO [RS:0;jenkins-hbase4:41173] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:03:40,300 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:03:40,300 INFO [RS:0;jenkins-hbase4:41173] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:03:40,300 INFO [RS:1;jenkins-hbase4:36967] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:03:40,301 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:03:40,301 INFO [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(3304): Received CLOSE for c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:40,301 INFO [RS:1;jenkins-hbase4:36967] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:03:40,302 INFO [RS:1;jenkins-hbase4:36967] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:03:40,302 INFO [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:40,302 DEBUG [RS:1;jenkins-hbase4:36967] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75ac29fc to 127.0.0.1:64487 2023-02-13 16:03:40,302 DEBUG [RS:1;jenkins-hbase4:36967] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:40,302 INFO [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:40,302 INFO [RS:1;jenkins-hbase4:36967] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:03:40,303 DEBUG [RS:0;jenkins-hbase4:41173] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37687ebc to 127.0.0.1:64487 2023-02-13 16:03:40,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing c773071ee94ece081aa8d20501a777c5, disabling compactions & flushes 2023-02-13 16:03:40,303 DEBUG [RS:0;jenkins-hbase4:41173] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:40,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:40,303 INFO [RS:1;jenkins-hbase4:36967] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:03:40,303 INFO [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 16:03:40,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:40,303 DEBUG [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1479): Online Regions={c773071ee94ece081aa8d20501a777c5=hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5.} 2023-02-13 16:03:40,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. after waiting 0 ms 2023-02-13 16:03:40,303 INFO [RS:1;jenkins-hbase4:36967] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:03:40,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:40,303 INFO [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 16:03:40,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing c773071ee94ece081aa8d20501a777c5 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 16:03:40,304 INFO [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 16:03:40,304 DEBUG [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 16:03:40,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:03:40,304 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:03:40,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:03:40,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:03:40,304 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:03:40,304 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=24.29 KB heapSize=40.20 KB 2023-02-13 16:03:40,306 DEBUG [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 16:03:40,306 DEBUG [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1505): Waiting on c773071ee94ece081aa8d20501a777c5 2023-02-13 16:03:40,324 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:40,324 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:40,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5/.tmp/info/e6fb7517ce9843e1a33732e7ef8de0ba 2023-02-13 16:03:40,349 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=22.08 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/.tmp/info/a508b0c88d3748c097e9df37c1718ced 2023-02-13 16:03:40,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5/.tmp/info/e6fb7517ce9843e1a33732e7ef8de0ba as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5/info/e6fb7517ce9843e1a33732e7ef8de0ba 2023-02-13 16:03:40,358 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a508b0c88d3748c097e9df37c1718ced 2023-02-13 16:03:40,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5/info/e6fb7517ce9843e1a33732e7ef8de0ba, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 16:03:40,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c773071ee94ece081aa8d20501a777c5 in 64ms, sequenceid=6, compaction requested=false 2023-02-13 16:03:40,372 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 16:03:40,373 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 16:03:40,385 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 16:03:40,386 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 16:03:40,386 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=997 B at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/.tmp/rep_barrier/1d0966aa4f3444a884a748ee48e6c2c8 2023-02-13 16:03:40,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/namespace/c773071ee94ece081aa8d20501a777c5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 16:03:40,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:40,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for c773071ee94ece081aa8d20501a777c5: Waiting for close lock at 1676304220302Running coprocessor pre-close hooks at 1676304220302Disabling compacts and flushes for region at 1676304220302Disabling writes for close at 1676304220303 (+1 ms)Obtaining lock to block concurrent updates at 1676304220303Preparing flush snapshotting stores in c773071ee94ece081aa8d20501a777c5 at 1676304220303Finished memstore snapshotting hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676304220304 (+1 ms)Flushing stores of hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. at 1676304220305 (+1 ms)Flushing c773071ee94ece081aa8d20501a777c5/info: creating writer at 1676304220305Flushing c773071ee94ece081aa8d20501a777c5/info: appending metadata at 1676304220308 (+3 ms)Flushing c773071ee94ece081aa8d20501a777c5/info: closing flushed file at 1676304220308Flushing c773071ee94ece081aa8d20501a777c5/info: reopening flushed file at 1676304220357 (+49 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c773071ee94ece081aa8d20501a777c5 in 64ms, sequenceid=6, compaction requested=false at 1676304220367 (+10 ms)Writing region close event to WAL at 1676304220381 (+14 ms)Running coprocessor post-close hooks at 1676304220391 (+10 ms)Closed at 1676304220391 2023-02-13 16:03:40,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676304210014.c773071ee94ece081aa8d20501a777c5. 2023-02-13 16:03:40,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d0966aa4f3444a884a748ee48e6c2c8 2023-02-13 16:03:40,416 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.24 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/.tmp/table/b769155f0543411180ab9784c61e5724 2023-02-13 16:03:40,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b769155f0543411180ab9784c61e5724 2023-02-13 16:03:40,424 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/.tmp/info/a508b0c88d3748c097e9df37c1718ced as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/info/a508b0c88d3748c097e9df37c1718ced 2023-02-13 16:03:40,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a508b0c88d3748c097e9df37c1718ced 2023-02-13 16:03:40,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/info/a508b0c88d3748c097e9df37c1718ced, entries=30, sequenceid=57, filesize=7.9 K 2023-02-13 16:03:40,431 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/.tmp/rep_barrier/1d0966aa4f3444a884a748ee48e6c2c8 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/rep_barrier/1d0966aa4f3444a884a748ee48e6c2c8 2023-02-13 16:03:40,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d0966aa4f3444a884a748ee48e6c2c8 2023-02-13 16:03:40,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/rep_barrier/1d0966aa4f3444a884a748ee48e6c2c8, entries=10, sequenceid=57, filesize=5.9 K 2023-02-13 16:03:40,437 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/.tmp/table/b769155f0543411180ab9784c61e5724 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/table/b769155f0543411180ab9784c61e5724 2023-02-13 16:03:40,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b769155f0543411180ab9784c61e5724 2023-02-13 16:03:40,443 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/table/b769155f0543411180ab9784c61e5724, entries=13, sequenceid=57, filesize=5.9 K 2023-02-13 16:03:40,444 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 140ms, sequenceid=57, compaction requested=false 2023-02-13 16:03:40,452 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-13 16:03:40,453 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 16:03:40,454 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:03:40,454 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304220304Running coprocessor pre-close hooks at 1676304220304Disabling compacts and flushes for region at 1676304220304Disabling writes for close at 1676304220304Obtaining lock to block concurrent updates at 1676304220304Preparing flush snapshotting stores in 1588230740 at 1676304220304Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=24876, getHeapSize=41120, getOffHeapSize=0, getCellsCount=207 at 1676304220305 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676304220306 (+1 ms)Flushing 1588230740/info: creating writer at 1676304220306Flushing 1588230740/info: appending metadata at 1676304220311 (+5 ms)Flushing 1588230740/info: closing flushed file at 1676304220311Flushing 1588230740/rep_barrier: creating writer at 1676304220358 (+47 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676304220362 (+4 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676304220362Flushing 1588230740/table: creating writer at 1676304220396 (+34 ms)Flushing 1588230740/table: appending metadata at 1676304220399 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676304220399Flushing 1588230740/info: reopening flushed file at 1676304220425 (+26 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676304220432 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1676304220438 (+6 ms)Finished flush of dataSize ~24.29 KB/24876, heapSize ~40.16 KB/41120, currentSize=0 B/0 for 1588230740 in 140ms, sequenceid=57, compaction requested=false at 1676304220444 (+6 ms)Writing region close event to WAL at 1676304220449 (+5 ms)Running coprocessor post-close hooks at 1676304220453 (+4 ms)Closed at 1676304220454 (+1 ms) 2023-02-13 16:03:40,454 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 16:03:40,506 INFO [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36967,1676304208000; all regions closed. 2023-02-13 16:03:40,506 INFO [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41173,1676304207946; all regions closed. 2023-02-13 16:03:40,517 DEBUG [RS:0;jenkins-hbase4:41173] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/oldWALs 2023-02-13 16:03:40,517 DEBUG [RS:1;jenkins-hbase4:36967] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/oldWALs 2023-02-13 16:03:40,517 INFO [RS:0;jenkins-hbase4:41173] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41173%2C1676304207946:(num 1676304210442) 2023-02-13 16:03:40,517 INFO [RS:1;jenkins-hbase4:36967] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36967%2C1676304208000.meta:.meta(num 1676304209753) 2023-02-13 16:03:40,517 DEBUG [RS:0;jenkins-hbase4:41173] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:40,517 INFO [RS:0;jenkins-hbase4:41173] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:40,518 INFO [RS:0;jenkins-hbase4:41173] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 16:03:40,518 INFO [RS:0;jenkins-hbase4:41173] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:03:40,518 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:03:40,518 INFO [RS:0;jenkins-hbase4:41173] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:03:40,518 INFO [RS:0;jenkins-hbase4:41173] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:03:40,524 INFO [RS:0;jenkins-hbase4:41173] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41173 2023-02-13 16:03:40,532 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:40,532 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:40,532 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:40,532 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41173,1676304207946 2023-02-13 16:03:40,533 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:40,533 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@44dbe0a0 rejected from java.util.concurrent.ThreadPoolExecutor@40e47ce3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:40,533 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41173,1676304207946] 2023-02-13 16:03:40,533 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41173,1676304207946; numProcessing=1 2023-02-13 16:03:40,534 DEBUG [RS:1;jenkins-hbase4:36967] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/oldWALs 2023-02-13 16:03:40,534 INFO [RS:1;jenkins-hbase4:36967] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36967%2C1676304208000:(num 1676304210442) 2023-02-13 16:03:40,535 DEBUG [RS:1;jenkins-hbase4:36967] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:40,535 INFO [RS:1;jenkins-hbase4:36967] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:40,535 INFO [RS:1;jenkins-hbase4:36967] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 16:03:40,535 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:03:40,536 INFO [RS:1;jenkins-hbase4:36967] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36967 2023-02-13 16:03:40,538 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41173,1676304207946 already deleted, retry=false 2023-02-13 16:03:40,538 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41173,1676304207946 expired; onlineServers=1 2023-02-13 16:03:40,539 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36967,1676304208000 2023-02-13 16:03:40,539 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:40,539 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@619ca463 rejected from java.util.concurrent.ThreadPoolExecutor@65a32c88[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:40,540 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36967,1676304208000] 2023-02-13 16:03:40,540 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36967,1676304208000; numProcessing=2 2023-02-13 16:03:40,542 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36967,1676304208000 already deleted, retry=false 2023-02-13 16:03:40,542 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36967,1676304208000 expired; onlineServers=0 2023-02-13 16:03:40,542 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35105,1676304206758' ***** 2023-02-13 16:03:40,542 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 16:03:40,542 DEBUG [M:0;jenkins-hbase4:35105] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@685eb73a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:40,542 INFO [M:0;jenkins-hbase4:35105] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35105,1676304206758 2023-02-13 16:03:40,542 INFO [M:0;jenkins-hbase4:35105] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35105,1676304206758; all regions closed. 2023-02-13 16:03:40,542 DEBUG [M:0;jenkins-hbase4:35105] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:40,542 DEBUG [M:0;jenkins-hbase4:35105] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 16:03:40,543 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 16:03:40,543 DEBUG [M:0;jenkins-hbase4:35105] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 16:03:40,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304209196] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304209196,5,FailOnTimeoutGroup] 2023-02-13 16:03:40,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304209196] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304209196,5,FailOnTimeoutGroup] 2023-02-13 16:03:40,543 INFO [M:0;jenkins-hbase4:35105] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 16:03:40,545 INFO [M:0;jenkins-hbase4:35105] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 16:03:40,545 INFO [M:0;jenkins-hbase4:35105] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 16:03:40,545 DEBUG [M:0;jenkins-hbase4:35105] master.HMaster(1502): Stopping service threads 2023-02-13 16:03:40,545 INFO [M:0;jenkins-hbase4:35105] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 16:03:40,546 ERROR [M:0;jenkins-hbase4:35105] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-1,5,PEWorkerGroup] Thread[HFileArchiver-2,5,PEWorkerGroup] Thread[HFileArchiver-3,5,PEWorkerGroup] Thread[HFileArchiver-4,5,PEWorkerGroup] Thread[HFileArchiver-5,5,PEWorkerGroup] Thread[HFileArchiver-6,5,PEWorkerGroup] Thread[HFileArchiver-7,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] 2023-02-13 16:03:40,546 INFO [M:0;jenkins-hbase4:35105] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 16:03:40,546 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 16:03:40,552 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:40,552 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:40,552 DEBUG [M:0;jenkins-hbase4:35105] zookeeper.ZKUtil(398): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 16:03:40,552 WARN [M:0;jenkins-hbase4:35105] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 16:03:40,552 INFO [M:0;jenkins-hbase4:35105] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 16:03:40,553 INFO [M:0;jenkins-hbase4:35105] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 16:03:40,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:40,553 DEBUG [M:0;jenkins-hbase4:35105] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:03:40,553 INFO [M:0;jenkins-hbase4:35105] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:40,553 DEBUG [M:0;jenkins-hbase4:35105] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:40,553 DEBUG [M:0;jenkins-hbase4:35105] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:03:40,553 DEBUG [M:0;jenkins-hbase4:35105] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:40,553 INFO [M:0;jenkins-hbase4:35105] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=159.22 KB heapSize=192.14 KB 2023-02-13 16:03:40,567 INFO [M:0;jenkins-hbase4:35105] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=159.22 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8eb7d15a79cc4f249d7f793b34c0ac93 2023-02-13 16:03:40,572 DEBUG [M:0;jenkins-hbase4:35105] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8eb7d15a79cc4f249d7f793b34c0ac93 as hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8eb7d15a79cc4f249d7f793b34c0ac93 2023-02-13 16:03:40,578 INFO [M:0;jenkins-hbase4:35105] regionserver.HStore(1080): Added hdfs://localhost:36697/user/jenkins/test-data/3503553b-c5a3-64b7-d5f4-2b02ab515eac/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8eb7d15a79cc4f249d7f793b34c0ac93, entries=53, sequenceid=357, filesize=10.4 K 2023-02-13 16:03:40,579 INFO [M:0;jenkins-hbase4:35105] regionserver.HRegion(2947): Finished flush of dataSize ~159.22 KB/163044, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=357, compaction requested=false 2023-02-13 16:03:40,581 INFO [M:0;jenkins-hbase4:35105] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:40,581 DEBUG [M:0;jenkins-hbase4:35105] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304220553Disabling compacts and flushes for region at 1676304220553Disabling writes for close at 1676304220553Obtaining lock to block concurrent updates at 1676304220553Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676304220553Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=163044, getHeapSize=196736, getOffHeapSize=0, getCellsCount=442 at 1676304220554 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676304220555 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676304220555Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676304220559 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676304220559Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676304220573 (+14 ms)Finished flush of dataSize ~159.22 KB/163044, heapSize ~192.13 KB/196736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 26ms, sequenceid=357, compaction requested=false at 1676304220579 (+6 ms)Writing region close event to WAL at 1676304220581 (+2 ms)Closed at 1676304220581 2023-02-13 16:03:40,586 INFO [M:0;jenkins-hbase4:35105] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 16:03:40,586 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:03:40,592 INFO [M:0;jenkins-hbase4:35105] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35105 2023-02-13 16:03:40,595 DEBUG [M:0;jenkins-hbase4:35105] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35105,1676304206758 already deleted, retry=false 2023-02-13 16:03:40,634 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:40,634 INFO [RS:0;jenkins-hbase4:41173] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41173,1676304207946; zookeeper connection closed. 2023-02-13 16:03:40,635 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2fecd53b rejected from java.util.concurrent.ThreadPoolExecutor@40e47ce3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:40,635 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:41173-0x1004e6c31f30001, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:40,635 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@57c98f84 rejected from java.util.concurrent.ThreadPoolExecutor@40e47ce3[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 17] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:40,635 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@58bb2d9c] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@58bb2d9c 2023-02-13 16:03:40,735 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:40,735 INFO [M:0;jenkins-hbase4:35105] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35105,1676304206758; zookeeper connection closed. 2023-02-13 16:03:40,735 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5745db8b rejected from java.util.concurrent.ThreadPoolExecutor@2d5abd3f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:40,735 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): master:35105-0x1004e6c31f30000, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:40,735 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@377575be rejected from java.util.concurrent.ThreadPoolExecutor@2d5abd3f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:40,835 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:40,835 INFO [RS:1;jenkins-hbase4:36967] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36967,1676304208000; zookeeper connection closed. 2023-02-13 16:03:40,835 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@15f04933 rejected from java.util.concurrent.ThreadPoolExecutor@65a32c88[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:40,835 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3715d555] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3715d555 2023-02-13 16:03:40,835 DEBUG [Listener at localhost/36263-EventThread] zookeeper.ZKWatcher(600): regionserver:36967-0x1004e6c31f30002, quorum=127.0.0.1:64487, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:40,836 ERROR [Listener at localhost/36263-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d70f18f rejected from java.util.concurrent.ThreadPoolExecutor@65a32c88[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:40,836 INFO [Listener at localhost/36263] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 16:03:40,837 WARN [Listener at localhost/36263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:03:40,842 INFO [Listener at localhost/36263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:03:40,947 WARN [BP-304533811-172.31.14.131-1676304203098 heartbeating to localhost/127.0.0.1:36697] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:03:40,947 WARN [BP-304533811-172.31.14.131-1676304203098 heartbeating to localhost/127.0.0.1:36697] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-304533811-172.31.14.131-1676304203098 (Datanode Uuid 8541c6c3-226e-40d4-bb30-76652be545c0) service to localhost/127.0.0.1:36697 2023-02-13 16:03:40,949 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/cluster_fb53fa58-d420-547f-422d-aaebeb81b873/dfs/data/data3/current/BP-304533811-172.31.14.131-1676304203098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:40,949 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/cluster_fb53fa58-d420-547f-422d-aaebeb81b873/dfs/data/data4/current/BP-304533811-172.31.14.131-1676304203098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:40,951 WARN [Listener at localhost/36263] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:03:40,954 INFO [Listener at localhost/36263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:03:41,058 WARN [BP-304533811-172.31.14.131-1676304203098 heartbeating to localhost/127.0.0.1:36697] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:03:41,058 WARN [BP-304533811-172.31.14.131-1676304203098 heartbeating to localhost/127.0.0.1:36697] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-304533811-172.31.14.131-1676304203098 (Datanode Uuid b7453fc8-ad9d-4a4f-8eb5-5d292ec6f2a1) service to localhost/127.0.0.1:36697 2023-02-13 16:03:41,058 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/cluster_fb53fa58-d420-547f-422d-aaebeb81b873/dfs/data/data1/current/BP-304533811-172.31.14.131-1676304203098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:41,059 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/cluster_fb53fa58-d420-547f-422d-aaebeb81b873/dfs/data/data2/current/BP-304533811-172.31.14.131-1676304203098] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:41,094 INFO [Listener at localhost/36263] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:03:41,214 INFO [Listener at localhost/36263] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 16:03:41,277 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 16:03:41,294 INFO [Listener at localhost/36263] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceMultiRegion Thread=104 (was 7) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: SnapshotHandlerChoreCleaner sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:36697 from jenkins.hfs.1 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-2-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: region-location-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Monitor thread for TaskMonitor java.lang.Thread.sleep(Native Method) org.apache.hadoop.hbase.monitoring.TaskMonitor$MonitorRunnable.run(TaskMonitor.java:300) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.0@localhost:36697 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:36697 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-1-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: region-location-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: Listener at localhost/36263 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Idle-Rpc-Conn-Sweeper-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36697 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-1 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: LeaseRenewer:jenkins.hfs.1@localhost:36697 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RpcClient-timer-pool-0 java.lang.Thread.sleep(Native Method) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.waitForNextTick(HashedWheelTimer.java:600) org.apache.hbase.thirdparty.io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:496) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-4-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-2-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:36697 from jenkins.hfs.0 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner java.lang.Object.wait(Native Method) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144) java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165) org.apache.hadoop.fs.FileSystem$Statistics$StatisticsDataReferenceCleaner.run(FileSystem.java:3693) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: SessionTracker java.lang.Thread.sleep(Native Method) org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:151) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: ForkJoinPool-2-worker-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: nioEventLoopGroup-4-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: process reaper sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MemStoreChunkPool Statistics sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LruBlockCacheStatsExecutor sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:36697 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: (jenkins-hbase4.apache.org,35105,1676304206758)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-3-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: IPC Parameter Sending Thread #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LocalJobRunner Map Task Executor #0.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-3-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@3d5e6e8f java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:253) org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:46) org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:124) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-5-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HBase-Metrics2-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobFileCache #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: regionserver/jenkins-hbase4:0.procedureResultReporter sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.hadoop.hbase.regionserver.RemoteProcedureResultReporter.run(RemoteProcedureResultReporter.java:77) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=536 (was 240) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 192) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 166), AvailableMemoryMB=1872 (was 2858) 2023-02-13 16:03:41,344 INFO [Listener at localhost/36263] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=104, OpenFileDescriptor=536, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=165, AvailableMemoryMB=1871 2023-02-13 16:03:41,360 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/hadoop.log.dir so I do NOT create it in target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3 2023-02-13 16:03:41,360 WARN [Listener at localhost/36263] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 16:03:41,360 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/hadoop.tmp.dir so I do NOT create it in target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3 2023-02-13 16:03:41,360 WARN [Listener at localhost/36263] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/22a6df23-d535-6e96-4562-92eecbfed03c/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 16:03:41,360 DEBUG [Listener at localhost/36263] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3 2023-02-13 16:03:41,361 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 16:03:41,376 INFO [Listener at localhost/36263] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/cluster_4a3600c5-5432-cbb0-29fb-f1504a30eab5, deleteOnExit=true 2023-02-13 16:03:41,376 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 16:03:41,376 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/test.cache.data in system properties and HBase conf 2023-02-13 16:03:41,376 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 16:03:41,376 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/hadoop.log.dir in system properties and HBase conf 2023-02-13 16:03:41,377 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 16:03:41,377 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 16:03:41,377 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 16:03:41,377 DEBUG [Listener at localhost/36263] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 16:03:41,377 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:03:41,377 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:03:41,377 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 16:03:41,377 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:03:41,378 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 16:03:41,378 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 16:03:41,378 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:03:41,378 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:03:41,378 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 16:03:41,378 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/nfs.dump.dir in system properties and HBase conf 2023-02-13 16:03:41,378 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/java.io.tmpdir in system properties and HBase conf 2023-02-13 16:03:41,378 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:03:41,378 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 16:03:41,378 INFO [Listener at localhost/36263] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 16:03:41,383 WARN [Listener at localhost/36263] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:03:41,383 WARN [Listener at localhost/36263] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:03:41,436 WARN [Listener at localhost/36263] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:41,439 INFO [Listener at localhost/36263] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:41,445 INFO [Listener at localhost/36263] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/java.io.tmpdir/Jetty_localhost_41879_hdfs____edqbl3/webapp 2023-02-13 16:03:41,557 INFO [Listener at localhost/36263] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41879 2023-02-13 16:03:41,561 WARN [Listener at localhost/36263] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:03:41,562 WARN [Listener at localhost/36263] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:03:41,612 WARN [Listener at localhost/35349] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:41,631 WARN [Listener at localhost/35349] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:03:41,636 WARN [Listener at localhost/35349] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:41,637 INFO [Listener at localhost/35349] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:41,643 INFO [Listener at localhost/35349] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/java.io.tmpdir/Jetty_localhost_40701_datanode____.ua3dst/webapp 2023-02-13 16:03:41,736 INFO [Listener at localhost/35349] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40701 2023-02-13 16:03:41,743 WARN [Listener at localhost/39767] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:41,762 WARN [Listener at localhost/39767] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:03:41,764 WARN [Listener at localhost/39767] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:41,766 INFO [Listener at localhost/39767] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:41,772 INFO [Listener at localhost/39767] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/java.io.tmpdir/Jetty_localhost_41035_datanode____qdrn18/webapp 2023-02-13 16:03:41,856 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf710d5c81b170ff: Processing first storage report for DS-e08ca434-0cd3-431c-877a-0504e5afd404 from datanode d280f4e4-7c3a-4204-8cb5-9c02f831ff7f 2023-02-13 16:03:41,856 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf710d5c81b170ff: from storage DS-e08ca434-0cd3-431c-877a-0504e5afd404 node DatanodeRegistration(127.0.0.1:44155, datanodeUuid=d280f4e4-7c3a-4204-8cb5-9c02f831ff7f, infoPort=40153, infoSecurePort=0, ipcPort=39767, storageInfo=lv=-57;cid=testClusterID;nsid=2054743960;c=1676304221386), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:41,856 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf710d5c81b170ff: Processing first storage report for DS-fe7c1cd6-3fc8-44a4-b744-db78b6a1c8cc from datanode d280f4e4-7c3a-4204-8cb5-9c02f831ff7f 2023-02-13 16:03:41,857 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf710d5c81b170ff: from storage DS-fe7c1cd6-3fc8-44a4-b744-db78b6a1c8cc node DatanodeRegistration(127.0.0.1:44155, datanodeUuid=d280f4e4-7c3a-4204-8cb5-9c02f831ff7f, infoPort=40153, infoSecurePort=0, ipcPort=39767, storageInfo=lv=-57;cid=testClusterID;nsid=2054743960;c=1676304221386), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:41,894 INFO [Listener at localhost/39767] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41035 2023-02-13 16:03:41,908 WARN [Listener at localhost/44363] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:42,014 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae96dde385bc40d6: Processing first storage report for DS-450ff5ca-b69e-4e86-8b34-a4b6ca0db05f from datanode cf7954f6-b477-4cac-a222-7a42456d506c 2023-02-13 16:03:42,015 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae96dde385bc40d6: from storage DS-450ff5ca-b69e-4e86-8b34-a4b6ca0db05f node DatanodeRegistration(127.0.0.1:45105, datanodeUuid=cf7954f6-b477-4cac-a222-7a42456d506c, infoPort=40927, infoSecurePort=0, ipcPort=44363, storageInfo=lv=-57;cid=testClusterID;nsid=2054743960;c=1676304221386), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:42,015 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xae96dde385bc40d6: Processing first storage report for DS-84783063-57ab-4f8d-bb65-a8b0e59f2378 from datanode cf7954f6-b477-4cac-a222-7a42456d506c 2023-02-13 16:03:42,015 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xae96dde385bc40d6: from storage DS-84783063-57ab-4f8d-bb65-a8b0e59f2378 node DatanodeRegistration(127.0.0.1:45105, datanodeUuid=cf7954f6-b477-4cac-a222-7a42456d506c, infoPort=40927, infoSecurePort=0, ipcPort=44363, storageInfo=lv=-57;cid=testClusterID;nsid=2054743960;c=1676304221386), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:42,025 DEBUG [Listener at localhost/44363] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3 2023-02-13 16:03:42,032 INFO [Listener at localhost/44363] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/cluster_4a3600c5-5432-cbb0-29fb-f1504a30eab5/zookeeper_0, clientPort=57466, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/cluster_4a3600c5-5432-cbb0-29fb-f1504a30eab5/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/cluster_4a3600c5-5432-cbb0-29fb-f1504a30eab5/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 16:03:42,034 INFO [Listener at localhost/44363] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57466 2023-02-13 16:03:42,034 INFO [Listener at localhost/44363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,035 INFO [Listener at localhost/44363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,054 INFO [Listener at localhost/44363] util.FSUtils(479): Created version file at hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7 with version=8 2023-02-13 16:03:42,054 INFO [Listener at localhost/44363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,056 INFO [Listener at localhost/44363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,058 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/hbase-staging 2023-02-13 16:03:42,060 INFO [Listener at localhost/44363] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:42,060 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:42,060 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:42,061 INFO [Listener at localhost/44363] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:42,061 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:42,061 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:42,061 INFO [Listener at localhost/44363] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:42,064 INFO [Listener at localhost/44363] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40869 2023-02-13 16:03:42,065 INFO [Listener at localhost/44363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,066 INFO [Listener at localhost/44363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,068 INFO [Listener at localhost/44363] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40869 connecting to ZooKeeper ensemble=127.0.0.1:57466 2023-02-13 16:03:42,076 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:408690x0, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:42,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40869-0x1004e6c71100000 connected 2023-02-13 16:03:42,097 DEBUG [Listener at localhost/44363] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:42,097 DEBUG [Listener at localhost/44363] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:42,098 DEBUG [Listener at localhost/44363] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:42,104 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40869 2023-02-13 16:03:42,108 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40869 2023-02-13 16:03:42,110 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40869 2023-02-13 16:03:42,110 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40869 2023-02-13 16:03:42,112 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40869 2023-02-13 16:03:42,112 INFO [Listener at localhost/44363] master.HMaster(439): hbase.rootdir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7, hbase.cluster.distributed=false 2023-02-13 16:03:42,126 INFO [Listener at localhost/44363] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:42,127 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:42,127 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:42,127 INFO [Listener at localhost/44363] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:42,127 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:42,127 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:42,127 INFO [Listener at localhost/44363] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:42,130 INFO [Listener at localhost/44363] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39793 2023-02-13 16:03:42,131 INFO [Listener at localhost/44363] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:03:42,136 DEBUG [Listener at localhost/44363] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:42,137 INFO [Listener at localhost/44363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,138 INFO [Listener at localhost/44363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,140 INFO [Listener at localhost/44363] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39793 connecting to ZooKeeper ensemble=127.0.0.1:57466 2023-02-13 16:03:42,144 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:397930x0, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:42,145 DEBUG [Listener at localhost/44363] zookeeper.ZKUtil(164): regionserver:397930x0, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:42,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39793-0x1004e6c71100001 connected 2023-02-13 16:03:42,146 DEBUG [Listener at localhost/44363] zookeeper.ZKUtil(164): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:42,147 DEBUG [Listener at localhost/44363] zookeeper.ZKUtil(164): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:42,152 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39793 2023-02-13 16:03:42,152 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39793 2023-02-13 16:03:42,152 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39793 2023-02-13 16:03:42,154 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39793 2023-02-13 16:03:42,154 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39793 2023-02-13 16:03:42,167 INFO [Listener at localhost/44363] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:42,167 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:42,167 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:42,168 INFO [Listener at localhost/44363] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:42,168 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:42,168 INFO [Listener at localhost/44363] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:42,168 INFO [Listener at localhost/44363] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:42,171 INFO [Listener at localhost/44363] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35057 2023-02-13 16:03:42,171 INFO [Listener at localhost/44363] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:03:42,172 DEBUG [Listener at localhost/44363] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:42,173 INFO [Listener at localhost/44363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,174 INFO [Listener at localhost/44363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,175 INFO [Listener at localhost/44363] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35057 connecting to ZooKeeper ensemble=127.0.0.1:57466 2023-02-13 16:03:42,179 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:350570x0, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:42,181 DEBUG [Listener at localhost/44363] zookeeper.ZKUtil(164): regionserver:350570x0, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:42,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:35057-0x1004e6c71100002 connected 2023-02-13 16:03:42,182 DEBUG [Listener at localhost/44363] zookeeper.ZKUtil(164): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:42,182 DEBUG [Listener at localhost/44363] zookeeper.ZKUtil(164): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:42,184 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35057 2023-02-13 16:03:42,187 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35057 2023-02-13 16:03:42,189 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35057 2023-02-13 16:03:42,192 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35057 2023-02-13 16:03:42,192 DEBUG [Listener at localhost/44363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35057 2023-02-13 16:03:42,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40869,1676304222059 2023-02-13 16:03:42,196 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:03:42,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40869,1676304222059 2023-02-13 16:03:42,198 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:42,198 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:42,198 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:42,198 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:42,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:03:42,201 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:03:42,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40869,1676304222059 from backup master directory 2023-02-13 16:03:42,203 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40869,1676304222059 2023-02-13 16:03:42,203 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:03:42,203 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:42,203 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,40869,1676304222059 2023-02-13 16:03:42,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/hbase.id with ID: 0c2bccb7-ddd0-4231-a774-0f66904342b0 2023-02-13 16:03:42,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:42,246 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:42,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5823e739 to 127.0.0.1:57466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:42,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30444b72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:42,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:42,275 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 16:03:42,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:42,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/data/master/store-tmp 2023-02-13 16:03:42,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:42,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:03:42,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:42,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:42,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:03:42,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:42,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:42,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304222297Disabling compacts and flushes for region at 1676304222297Disabling writes for close at 1676304222297Writing region close event to WAL at 1676304222297Closed at 1676304222297 2023-02-13 16:03:42,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/WALs/jenkins-hbase4.apache.org,40869,1676304222059 2023-02-13 16:03:42,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40869%2C1676304222059, suffix=, logDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/WALs/jenkins-hbase4.apache.org,40869,1676304222059, archiveDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/oldWALs, maxLogs=10 2023-02-13 16:03:42,318 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44155,DS-e08ca434-0cd3-431c-877a-0504e5afd404,DISK] 2023-02-13 16:03:42,320 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45105,DS-450ff5ca-b69e-4e86-8b34-a4b6ca0db05f,DISK] 2023-02-13 16:03:42,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/WALs/jenkins-hbase4.apache.org,40869,1676304222059/jenkins-hbase4.apache.org%2C40869%2C1676304222059.1676304222301 2023-02-13 16:03:42,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44155,DS-e08ca434-0cd3-431c-877a-0504e5afd404,DISK], DatanodeInfoWithStorage[127.0.0.1:45105,DS-450ff5ca-b69e-4e86-8b34-a4b6ca0db05f,DISK]] 2023-02-13 16:03:42,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:42,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:42,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:42,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:42,330 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:42,331 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 16:03:42,332 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 16:03:42,332 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:42,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:42,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:42,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:42,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:42,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75072877, jitterRate=0.11867304146289825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:03:42,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676304222328Initializing all the Stores at 1676304222329 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304222329Cleaning up temporary data from old regions at 1676304222334 (+5 ms)Cleaning up detritus from prior splits at 1676304222335 (+1 ms)Region opened successfully at 1676304222339 (+4 ms) 2023-02-13 16:03:42,339 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 16:03:42,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 16:03:42,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 16:03:42,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 16:03:42,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-13 16:03:42,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 16:03:42,342 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 16:03:42,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 16:03:42,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 16:03:42,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 16:03:42,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 16:03:42,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 16:03:42,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 16:03:42,363 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 16:03:42,370 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:42,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 16:03:42,371 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 16:03:42,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 16:03:42,374 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:42,374 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:42,375 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:42,377 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:42,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,40869,1676304222059, sessionid=0x1004e6c71100000, setting cluster-up flag (Was=false) 2023-02-13 16:03:42,384 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:42,390 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 16:03:42,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40869,1676304222059 2023-02-13 16:03:42,397 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:42,403 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 16:03:42,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40869,1676304222059 2023-02-13 16:03:42,405 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.hbase-snapshot/.tmp 2023-02-13 16:03:42,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:42,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:42,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:42,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:42,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:42,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 16:03:42,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:42,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676304252427 2023-02-13 16:03:42,427 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 16:03:42,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 16:03:42,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 16:03:42,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 16:03:42,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 16:03:42,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 16:03:42,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,432 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:42,432 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 16:03:42,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 16:03:42,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 16:03:42,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 16:03:42,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 16:03:42,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 16:03:42,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304222433,5,FailOnTimeoutGroup] 2023-02-13 16:03:42,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304222435,5,FailOnTimeoutGroup] 2023-02-13 16:03:42,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 16:03:42,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,436 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:42,456 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:42,456 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:42,457 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7 2023-02-13 16:03:42,477 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:42,479 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:03:42,480 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/info 2023-02-13 16:03:42,481 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:03:42,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:42,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:03:42,484 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:42,485 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:03:42,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:42,486 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:03:42,487 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/table 2023-02-13 16:03:42,488 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:03:42,488 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:42,489 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740 2023-02-13 16:03:42,489 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740 2023-02-13 16:03:42,492 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:03:42,497 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:03:42,500 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:42,501 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68586287, jitterRate=0.022015318274497986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:03:42,501 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676304222477Initializing all the Stores at 1676304222478 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304222478Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304222478Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304222478Cleaning up temporary data from old regions at 1676304222491 (+13 ms)Cleaning up detritus from prior splits at 1676304222491Region opened successfully at 1676304222501 (+10 ms) 2023-02-13 16:03:42,501 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:03:42,501 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:03:42,501 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:03:42,501 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:03:42,501 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:03:42,504 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:03:42,504 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304222501Disabling compacts and flushes for region at 1676304222501Disabling writes for close at 1676304222501Writing region close event to WAL at 1676304222504 (+3 ms)Closed at 1676304222504 2023-02-13 16:03:42,505 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:42,505 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 16:03:42,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 16:03:42,508 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 16:03:42,510 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 16:03:42,512 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(952): ClusterId : 0c2bccb7-ddd0-4231-a774-0f66904342b0 2023-02-13 16:03:42,512 DEBUG [RS:0;jenkins-hbase4:39793] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:03:42,513 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(952): ClusterId : 0c2bccb7-ddd0-4231-a774-0f66904342b0 2023-02-13 16:03:42,513 DEBUG [RS:1;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:03:42,515 DEBUG [RS:1;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:03:42,516 DEBUG [RS:1;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:03:42,518 DEBUG [RS:1;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:03:42,520 DEBUG [RS:0;jenkins-hbase4:39793] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:03:42,520 DEBUG [RS:1;jenkins-hbase4:35057] zookeeper.ReadOnlyZKClient(139): Connect 0x4279d68a to 127.0.0.1:57466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:42,520 DEBUG [RS:0;jenkins-hbase4:39793] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:03:42,529 DEBUG [RS:0;jenkins-hbase4:39793] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:03:42,531 DEBUG [RS:0;jenkins-hbase4:39793] zookeeper.ReadOnlyZKClient(139): Connect 0x45eb441e to 127.0.0.1:57466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:42,532 DEBUG [RS:1;jenkins-hbase4:35057] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cbe20b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:42,532 DEBUG [RS:1;jenkins-hbase4:35057] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4881bdfa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:42,545 DEBUG [RS:0;jenkins-hbase4:39793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b2cb2d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:42,545 DEBUG [RS:0;jenkins-hbase4:39793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f132f6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:42,549 DEBUG [RS:1;jenkins-hbase4:35057] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35057 2023-02-13 16:03:42,549 INFO [RS:1;jenkins-hbase4:35057] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:03:42,549 INFO [RS:1;jenkins-hbase4:35057] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:03:42,549 DEBUG [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:03:42,550 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40869,1676304222059 with isa=jenkins-hbase4.apache.org/172.31.14.131:35057, startcode=1676304222167 2023-02-13 16:03:42,550 DEBUG [RS:1;jenkins-hbase4:35057] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:03:42,557 INFO [RS-EventLoopGroup-6-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49235, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.3 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:03:42,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:42,559 DEBUG [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7 2023-02-13 16:03:42,559 DEBUG [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35349 2023-02-13 16:03:42,559 DEBUG [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:03:42,561 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:42,561 DEBUG [RS:0;jenkins-hbase4:39793] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39793 2023-02-13 16:03:42,561 INFO [RS:0;jenkins-hbase4:39793] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:03:42,561 INFO [RS:0;jenkins-hbase4:39793] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:03:42,561 DEBUG [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:03:42,561 DEBUG [RS:1;jenkins-hbase4:35057] zookeeper.ZKUtil(162): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:42,561 WARN [RS:1;jenkins-hbase4:35057] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:42,561 INFO [RS:1;jenkins-hbase4:35057] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:42,562 DEBUG [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/WALs/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:42,562 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,40869,1676304222059 with isa=jenkins-hbase4.apache.org/172.31.14.131:39793, startcode=1676304222126 2023-02-13 16:03:42,563 DEBUG [RS:0;jenkins-hbase4:39793] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:03:42,563 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35057,1676304222167] 2023-02-13 16:03:42,585 DEBUG [RS:1;jenkins-hbase4:35057] zookeeper.ZKUtil(162): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:42,585 INFO [RS-EventLoopGroup-6-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38501, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:03:42,586 DEBUG [RS:1;jenkins-hbase4:35057] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:03:42,586 INFO [RS:1;jenkins-hbase4:35057] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:03:42,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:42,596 DEBUG [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7 2023-02-13 16:03:42,596 DEBUG [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:35349 2023-02-13 16:03:42,596 DEBUG [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:03:42,600 INFO [RS:1;jenkins-hbase4:35057] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:03:42,601 INFO [RS:1;jenkins-hbase4:35057] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:03:42,601 INFO [RS:1;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,601 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:42,601 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:42,602 DEBUG [RS:0;jenkins-hbase4:39793] zookeeper.ZKUtil(162): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:42,602 WARN [RS:0;jenkins-hbase4:39793] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:42,602 INFO [RS:0;jenkins-hbase4:39793] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:42,602 DEBUG [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1947): logDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/WALs/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:42,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:42,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:42,608 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:03:42,609 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39793,1676304222126] 2023-02-13 16:03:42,625 INFO [RS:1;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,626 DEBUG [RS:1;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,626 DEBUG [RS:1;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,626 DEBUG [RS:1;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,626 DEBUG [RS:1;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,626 DEBUG [RS:1;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,626 DEBUG [RS:1;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:42,626 DEBUG [RS:1;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,626 DEBUG [RS:1;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,626 DEBUG [RS:1;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,627 DEBUG [RS:1;jenkins-hbase4:35057] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,655 INFO [RS:1;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,655 INFO [RS:1;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,655 INFO [RS:1;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,660 DEBUG [jenkins-hbase4:40869] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 16:03:42,660 DEBUG [jenkins-hbase4:40869] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:42,673 DEBUG [jenkins-hbase4:40869] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:42,673 DEBUG [jenkins-hbase4:40869] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:42,673 DEBUG [jenkins-hbase4:40869] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:42,674 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35057,1676304222167, state=OPENING 2023-02-13 16:03:42,674 DEBUG [RS:0;jenkins-hbase4:39793] zookeeper.ZKUtil(162): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:42,675 DEBUG [RS:0;jenkins-hbase4:39793] zookeeper.ZKUtil(162): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:42,675 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 16:03:42,677 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:42,677 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:03:42,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35057,1676304222167}] 2023-02-13 16:03:42,681 DEBUG [RS:0;jenkins-hbase4:39793] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:03:42,681 INFO [RS:0;jenkins-hbase4:39793] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:03:42,684 INFO [RS:1;jenkins-hbase4:35057] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:03:42,684 INFO [RS:1;jenkins-hbase4:35057] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35057,1676304222167-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,692 INFO [RS:0;jenkins-hbase4:39793] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:03:42,716 INFO [RS:0;jenkins-hbase4:39793] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:03:42,716 INFO [RS:0;jenkins-hbase4:39793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,728 INFO [RS:1;jenkins-hbase4:35057] regionserver.Replication(203): jenkins-hbase4.apache.org,35057,1676304222167 started 2023-02-13 16:03:42,728 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,35057,1676304222167, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35057, sessionid=0x1004e6c71100002 2023-02-13 16:03:42,729 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:03:42,729 DEBUG [RS:1;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:03:42,729 DEBUG [RS:1;jenkins-hbase4:35057] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:42,729 DEBUG [RS:1;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35057,1676304222167' 2023-02-13 16:03:42,729 DEBUG [RS:1;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:42,731 INFO [RS:0;jenkins-hbase4:39793] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,731 DEBUG [RS:0;jenkins-hbase4:39793] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,731 DEBUG [RS:0;jenkins-hbase4:39793] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,731 DEBUG [RS:0;jenkins-hbase4:39793] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,731 DEBUG [RS:0;jenkins-hbase4:39793] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,731 DEBUG [RS:0;jenkins-hbase4:39793] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,731 DEBUG [RS:0;jenkins-hbase4:39793] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:42,732 DEBUG [RS:0;jenkins-hbase4:39793] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,732 DEBUG [RS:0;jenkins-hbase4:39793] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,732 DEBUG [RS:0;jenkins-hbase4:39793] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,732 DEBUG [RS:0;jenkins-hbase4:39793] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:42,736 DEBUG [RS:1;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:42,737 DEBUG [RS:1;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:03:42,737 DEBUG [RS:1;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:03:42,737 DEBUG [RS:1;jenkins-hbase4:35057] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:42,737 DEBUG [RS:1;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35057,1676304222167' 2023-02-13 16:03:42,737 DEBUG [RS:1;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:42,737 DEBUG [RS:1;jenkins-hbase4:35057] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:42,738 DEBUG [RS:1;jenkins-hbase4:35057] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:03:42,738 INFO [RS:1;jenkins-hbase4:35057] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:03:42,738 INFO [RS:1;jenkins-hbase4:35057] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:03:42,756 INFO [RS:0;jenkins-hbase4:39793] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,756 INFO [RS:0;jenkins-hbase4:39793] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,756 INFO [RS:0;jenkins-hbase4:39793] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,785 INFO [RS:0;jenkins-hbase4:39793] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:03:42,785 INFO [RS:0;jenkins-hbase4:39793] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39793,1676304222126-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,816 INFO [RS:0;jenkins-hbase4:39793] regionserver.Replication(203): jenkins-hbase4.apache.org,39793,1676304222126 started 2023-02-13 16:03:42,816 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,39793,1676304222126, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39793, sessionid=0x1004e6c71100001 2023-02-13 16:03:42,816 DEBUG [RS:0;jenkins-hbase4:39793] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:03:42,817 DEBUG [RS:0;jenkins-hbase4:39793] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:42,817 DEBUG [RS:0;jenkins-hbase4:39793] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39793,1676304222126' 2023-02-13 16:03:42,817 DEBUG [RS:0;jenkins-hbase4:39793] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:42,817 DEBUG [RS:0;jenkins-hbase4:39793] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:42,818 DEBUG [RS:0;jenkins-hbase4:39793] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:03:42,818 DEBUG [RS:0;jenkins-hbase4:39793] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:03:42,818 DEBUG [RS:0;jenkins-hbase4:39793] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:42,818 DEBUG [RS:0;jenkins-hbase4:39793] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39793,1676304222126' 2023-02-13 16:03:42,818 DEBUG [RS:0;jenkins-hbase4:39793] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:42,818 DEBUG [RS:0;jenkins-hbase4:39793] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:42,819 DEBUG [RS:0;jenkins-hbase4:39793] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:03:42,819 INFO [RS:0;jenkins-hbase4:39793] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:03:42,819 INFO [RS:0;jenkins-hbase4:39793] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:03:42,832 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:42,833 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:03:42,836 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34122, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:03:42,844 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 16:03:42,844 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:42,855 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35057%2C1676304222167.meta, suffix=.meta, logDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/WALs/jenkins-hbase4.apache.org,35057,1676304222167, archiveDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/oldWALs, maxLogs=32 2023-02-13 16:03:42,876 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45105,DS-450ff5ca-b69e-4e86-8b34-a4b6ca0db05f,DISK] 2023-02-13 16:03:42,877 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44155,DS-e08ca434-0cd3-431c-877a-0504e5afd404,DISK] 2023-02-13 16:03:42,879 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/WALs/jenkins-hbase4.apache.org,35057,1676304222167/jenkins-hbase4.apache.org%2C35057%2C1676304222167.meta.1676304222857.meta 2023-02-13 16:03:42,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44155,DS-e08ca434-0cd3-431c-877a-0504e5afd404,DISK], DatanodeInfoWithStorage[127.0.0.1:45105,DS-450ff5ca-b69e-4e86-8b34-a4b6ca0db05f,DISK]] 2023-02-13 16:03:42,879 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:42,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 16:03:42,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 16:03:42,881 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 16:03:42,881 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 16:03:42,881 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:42,881 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 16:03:42,881 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 16:03:42,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:03:42,887 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/info 2023-02-13 16:03:42,887 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/info 2023-02-13 16:03:42,887 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:03:42,888 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:42,888 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:03:42,889 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:42,889 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:42,890 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:03:42,890 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:42,890 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:03:42,893 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/table 2023-02-13 16:03:42,893 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/table 2023-02-13 16:03:42,893 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:03:42,894 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:42,895 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740 2023-02-13 16:03:42,896 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740 2023-02-13 16:03:42,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:03:42,900 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:03:42,901 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62598832, jitterRate=-0.06720471382141113}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:03:42,901 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676304222881Writing region info on filesystem at 1676304222881Initializing all the Stores at 1676304222883 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304222884 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304222884Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304222884Cleaning up temporary data from old regions at 1676304222897 (+13 ms)Cleaning up detritus from prior splits at 1676304222898 (+1 ms)Running coprocessor post-open hooks at 1676304222901 (+3 ms)Region opened successfully at 1676304222901 2023-02-13 16:03:42,902 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676304222832 2023-02-13 16:03:42,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 16:03:42,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 16:03:42,909 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35057,1676304222167, state=OPEN 2023-02-13 16:03:42,910 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 16:03:42,910 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:03:42,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 16:03:42,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35057,1676304222167 in 233 msec 2023-02-13 16:03:42,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 16:03:42,915 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 407 msec 2023-02-13 16:03:42,917 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 508 msec 2023-02-13 16:03:42,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676304222196, completionTime=-1 2023-02-13 16:03:42,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 16:03:42,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 16:03:42,928 DEBUG [hconnection-0x6cbd77f3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:42,931 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34132, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:42,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 16:03:42,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676304282933 2023-02-13 16:03:42,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676304342933 2023-02-13 16:03:42,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 15 msec 2023-02-13 16:03:42,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40869,1676304222059-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40869,1676304222059-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40869,1676304222059-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40869, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:42,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 16:03:42,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:42,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 16:03:42,946 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:03:42,946 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 16:03:42,947 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:03:42,949 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1 2023-02-13 16:03:42,949 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1 empty. 2023-02-13 16:03:42,950 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1 2023-02-13 16:03:42,950 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 16:03:42,980 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:42,982 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5091a65bef236c48f1fb739e6d84bea1, NAME => 'hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,005 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,006 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 5091a65bef236c48f1fb739e6d84bea1, disabling compactions & flushes 2023-02-13 16:03:43,006 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:43,006 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:43,006 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. after waiting 0 ms 2023-02-13 16:03:43,006 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:43,006 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:43,006 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 5091a65bef236c48f1fb739e6d84bea1: Waiting for close lock at 1676304223006Disabling compacts and flushes for region at 1676304223006Disabling writes for close at 1676304223006Writing region close event to WAL at 1676304223006Closed at 1676304223006 2023-02-13 16:03:43,009 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:03:43,010 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304223010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223010"}]},"ts":"1676304223010"} 2023-02-13 16:03:43,013 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:03:43,014 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:03:43,014 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304223014"}]},"ts":"1676304223014"} 2023-02-13 16:03:43,016 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 16:03:43,019 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:43,020 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:43,020 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:43,020 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:43,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5091a65bef236c48f1fb739e6d84bea1, ASSIGN}] 2023-02-13 16:03:43,023 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5091a65bef236c48f1fb739e6d84bea1, ASSIGN 2023-02-13 16:03:43,024 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5091a65bef236c48f1fb739e6d84bea1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35057,1676304222167; forceNewPlan=false, retain=false 2023-02-13 16:03:43,175 INFO [jenkins-hbase4:40869] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:03:43,176 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5091a65bef236c48f1fb739e6d84bea1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:43,176 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304223176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223176"}]},"ts":"1676304223176"} 2023-02-13 16:03:43,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5091a65bef236c48f1fb739e6d84bea1, server=jenkins-hbase4.apache.org,35057,1676304222167}] 2023-02-13 16:03:43,335 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:43,337 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35057%2C1676304222167, suffix=, logDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/WALs/jenkins-hbase4.apache.org,35057,1676304222167, archiveDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/oldWALs, maxLogs=32 2023-02-13 16:03:43,357 DEBUG [RS-EventLoopGroup-8-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45105,DS-450ff5ca-b69e-4e86-8b34-a4b6ca0db05f,DISK] 2023-02-13 16:03:43,359 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44155,DS-e08ca434-0cd3-431c-877a-0504e5afd404,DISK] 2023-02-13 16:03:43,362 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/WALs/jenkins-hbase4.apache.org,35057,1676304222167/jenkins-hbase4.apache.org%2C35057%2C1676304222167.1676304223338 2023-02-13 16:03:43,364 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45105,DS-450ff5ca-b69e-4e86-8b34-a4b6ca0db05f,DISK], DatanodeInfoWithStorage[127.0.0.1:44155,DS-e08ca434-0cd3-431c-877a-0504e5afd404,DISK]] 2023-02-13 16:03:43,364 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5091a65bef236c48f1fb739e6d84bea1, NAME => 'hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:43,364 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5091a65bef236c48f1fb739e6d84bea1 2023-02-13 16:03:43,364 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,364 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5091a65bef236c48f1fb739e6d84bea1 2023-02-13 16:03:43,364 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5091a65bef236c48f1fb739e6d84bea1 2023-02-13 16:03:43,366 INFO [StoreOpener-5091a65bef236c48f1fb739e6d84bea1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5091a65bef236c48f1fb739e6d84bea1 2023-02-13 16:03:43,368 DEBUG [StoreOpener-5091a65bef236c48f1fb739e6d84bea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1/info 2023-02-13 16:03:43,368 DEBUG [StoreOpener-5091a65bef236c48f1fb739e6d84bea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1/info 2023-02-13 16:03:43,368 INFO [StoreOpener-5091a65bef236c48f1fb739e6d84bea1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5091a65bef236c48f1fb739e6d84bea1 columnFamilyName info 2023-02-13 16:03:43,369 INFO [StoreOpener-5091a65bef236c48f1fb739e6d84bea1-1] regionserver.HStore(310): Store=5091a65bef236c48f1fb739e6d84bea1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:43,369 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1 2023-02-13 16:03:43,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1 2023-02-13 16:03:43,373 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5091a65bef236c48f1fb739e6d84bea1 2023-02-13 16:03:43,375 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:43,375 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5091a65bef236c48f1fb739e6d84bea1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73360844, jitterRate=0.09316176176071167}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:03:43,376 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5091a65bef236c48f1fb739e6d84bea1: Running coprocessor pre-open hook at 1676304223365Writing region info on filesystem at 1676304223365Initializing all the Stores at 1676304223366 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304223366Cleaning up temporary data from old regions at 1676304223370 (+4 ms)Cleaning up detritus from prior splits at 1676304223371 (+1 ms)Running coprocessor post-open hooks at 1676304223376 (+5 ms)Region opened successfully at 1676304223376 2023-02-13 16:03:43,376 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1., pid=6, masterSystemTime=1676304223331 2023-02-13 16:03:43,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:43,379 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:43,380 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5091a65bef236c48f1fb739e6d84bea1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:43,380 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304223380"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304223380"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304223380"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304223380"}]},"ts":"1676304223380"} 2023-02-13 16:03:43,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 16:03:43,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5091a65bef236c48f1fb739e6d84bea1, server=jenkins-hbase4.apache.org,35057,1676304222167 in 204 msec 2023-02-13 16:03:43,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 16:03:43,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5091a65bef236c48f1fb739e6d84bea1, ASSIGN in 364 msec 2023-02-13 16:03:43,386 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:03:43,386 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304223386"}]},"ts":"1676304223386"} 2023-02-13 16:03:43,388 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 16:03:43,392 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:03:43,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 451 msec 2023-02-13 16:03:43,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 16:03:43,445 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:43,446 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:43,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 16:03:43,464 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:43,467 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 15 msec 2023-02-13 16:03:43,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 16:03:43,484 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:43,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 12 msec 2023-02-13 16:03:43,499 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 16:03:43,503 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 16:03:43,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.300sec 2023-02-13 16:03:43,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 16:03:43,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 16:03:43,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 16:03:43,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40869,1676304222059-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 16:03:43,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40869,1676304222059-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 16:03:43,506 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 16:03:43,598 DEBUG [Listener at localhost/44363] zookeeper.ReadOnlyZKClient(139): Connect 0x241b9dd6 to 127.0.0.1:57466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:43,605 DEBUG [Listener at localhost/44363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ae69468, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:43,607 DEBUG [hconnection-0x3bc9668f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:43,610 INFO [RS-EventLoopGroup-8-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42842, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:43,612 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40869,1676304222059 2023-02-13 16:03:43,612 DEBUG [Listener at localhost/44363] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 16:03:43,614 DEBUG [Listener at localhost/44363] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 16:03:43,616 INFO [RS-EventLoopGroup-6-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51574, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 16:03:43,616 INFO [Listener at localhost/44363] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 16:03:43,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 16:03:43,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 16:03:43,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 77 connection: 172.31.14.131:51574 deadline: 1676304283617, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 16:03:43,618 INFO [Listener at localhost/44363] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 16:03:43,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:43,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 16:03:43,623 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:03:43,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 16:03:43,624 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:03:43,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:43,634 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:43,634 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:43,634 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:43,635 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:43,635 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:43,635 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:43,635 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f empty. 2023-02-13 16:03:43,635 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2 empty. 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2 empty. 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e empty. 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde empty. 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:43,636 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2 empty. 2023-02-13 16:03:43,637 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:43,637 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764 empty. 2023-02-13 16:03:43,637 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652 empty. 2023-02-13 16:03:43,637 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:43,637 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:43,638 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:43,638 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:43,638 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa empty. 2023-02-13 16:03:43,638 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948 empty. 2023-02-13 16:03:43,638 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:43,638 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:43,639 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 16:03:43,649 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:43,650 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => d49e5e9dc9c8c646aa9e4a6b3553ba1f, NAME => 'testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,650 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 121d5e32312bbfb25df57897b25d68c2, NAME => 'testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,652 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4a20bf98bd5b018f1a28063cb96011e2, NAME => 'testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,668 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,668 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 4a20bf98bd5b018f1a28063cb96011e2, disabling compactions & flushes 2023-02-13 16:03:43,668 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:43,668 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:43,668 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. after waiting 0 ms 2023-02-13 16:03:43,668 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:43,668 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:43,668 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 4a20bf98bd5b018f1a28063cb96011e2: Waiting for close lock at 1676304223668Disabling compacts and flushes for region at 1676304223668Disabling writes for close at 1676304223668Writing region close event to WAL at 1676304223668Closed at 1676304223668 2023-02-13 16:03:43,669 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3fbd1828b59558a2ffca1be9af02f6e2, NAME => 'testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,669 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,669 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing d49e5e9dc9c8c646aa9e4a6b3553ba1f, disabling compactions & flushes 2023-02-13 16:03:43,669 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:43,669 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:43,669 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. after waiting 0 ms 2023-02-13 16:03:43,669 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:43,669 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:43,669 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for d49e5e9dc9c8c646aa9e4a6b3553ba1f: Waiting for close lock at 1676304223669Disabling compacts and flushes for region at 1676304223669Disabling writes for close at 1676304223669Writing region close event to WAL at 1676304223669Closed at 1676304223669 2023-02-13 16:03:43,670 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b540b745c9d2f8a61806ca62f0ac6f9e, NAME => 'testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,670 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,670 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 121d5e32312bbfb25df57897b25d68c2, disabling compactions & flushes 2023-02-13 16:03:43,670 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:43,670 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:43,670 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. after waiting 0 ms 2023-02-13 16:03:43,670 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:43,670 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:43,670 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 121d5e32312bbfb25df57897b25d68c2: Waiting for close lock at 1676304223670Disabling compacts and flushes for region at 1676304223670Disabling writes for close at 1676304223670Writing region close event to WAL at 1676304223670Closed at 1676304223670 2023-02-13 16:03:43,671 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5cc0251f2a699eafc3b80793e4405fde, NAME => 'testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,680 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,680 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b540b745c9d2f8a61806ca62f0ac6f9e, disabling compactions & flushes 2023-02-13 16:03:43,680 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:43,680 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:43,680 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. after waiting 0 ms 2023-02-13 16:03:43,680 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:43,680 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:43,680 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b540b745c9d2f8a61806ca62f0ac6f9e: Waiting for close lock at 1676304223680Disabling compacts and flushes for region at 1676304223680Disabling writes for close at 1676304223680Writing region close event to WAL at 1676304223680Closed at 1676304223680 2023-02-13 16:03:43,680 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => 0b2a1bd67c080415da09adb5d6485652, NAME => 'testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,681 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,681 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing 3fbd1828b59558a2ffca1be9af02f6e2, disabling compactions & flushes 2023-02-13 16:03:43,681 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:43,681 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:43,681 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. after waiting 0 ms 2023-02-13 16:03:43,681 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:43,681 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:43,681 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for 3fbd1828b59558a2ffca1be9af02f6e2: Waiting for close lock at 1676304223681Disabling compacts and flushes for region at 1676304223681Disabling writes for close at 1676304223681Writing region close event to WAL at 1676304223681Closed at 1676304223681 2023-02-13 16:03:43,681 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => ba17dfff6d375413082eb96ecdbfe764, NAME => 'testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 5cc0251f2a699eafc3b80793e4405fde, disabling compactions & flushes 2023-02-13 16:03:43,685 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:43,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:43,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. after waiting 0 ms 2023-02-13 16:03:43,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:43,685 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:43,685 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 5cc0251f2a699eafc3b80793e4405fde: Waiting for close lock at 1676304223685Disabling compacts and flushes for region at 1676304223685Disabling writes for close at 1676304223685Writing region close event to WAL at 1676304223685Closed at 1676304223685 2023-02-13 16:03:43,686 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(7671): creating {ENCODED => 397270e8716ff8c1be713a2aac73d948, NAME => 'testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,700 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,700 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing ba17dfff6d375413082eb96ecdbfe764, disabling compactions & flushes 2023-02-13 16:03:43,700 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:43,700 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:43,701 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. after waiting 0 ms 2023-02-13 16:03:43,701 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:43,701 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:43,701 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for ba17dfff6d375413082eb96ecdbfe764: Waiting for close lock at 1676304223700Disabling compacts and flushes for region at 1676304223700Disabling writes for close at 1676304223701 (+1 ms)Writing region close event to WAL at 1676304223701Closed at 1676304223701 2023-02-13 16:03:43,701 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(7671): creating {ENCODED => bee40e2fed40d46b5f11b2d0c6c6c9fa, NAME => 'testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.tmp 2023-02-13 16:03:43,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1603): Closing 397270e8716ff8c1be713a2aac73d948, disabling compactions & flushes 2023-02-13 16:03:43,708 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:43,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,708 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:43,709 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. after waiting 0 ms 2023-02-13 16:03:43,709 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing 0b2a1bd67c080415da09adb5d6485652, disabling compactions & flushes 2023-02-13 16:03:43,709 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:43,709 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:43,709 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:43,709 INFO [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:43,709 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. after waiting 0 ms 2023-02-13 16:03:43,709 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:43,709 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-1] regionserver.HRegion(1557): Region close journal for 397270e8716ff8c1be713a2aac73d948: Waiting for close lock at 1676304223708Disabling compacts and flushes for region at 1676304223708Disabling writes for close at 1676304223709 (+1 ms)Writing region close event to WAL at 1676304223709Closed at 1676304223709 2023-02-13 16:03:43,709 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:43,709 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for 0b2a1bd67c080415da09adb5d6485652: Waiting for close lock at 1676304223709Disabling compacts and flushes for region at 1676304223709Disabling writes for close at 1676304223709Writing region close event to WAL at 1676304223709Closed at 1676304223709 2023-02-13 16:03:43,721 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:43,721 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1603): Closing bee40e2fed40d46b5f11b2d0c6c6c9fa, disabling compactions & flushes 2023-02-13 16:03:43,721 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:43,721 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:43,721 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. after waiting 0 ms 2023-02-13 16:03:43,721 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:43,721 INFO [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:43,721 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-2] regionserver.HRegion(1557): Region close journal for bee40e2fed40d46b5f11b2d0c6c6c9fa: Waiting for close lock at 1676304223721Disabling compacts and flushes for region at 1676304223721Disabling writes for close at 1676304223721Writing region close event to WAL at 1676304223721Closed at 1676304223721 2023-02-13 16:03:43,725 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:03:43,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:43,727 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,d\\x84\\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223727"}]},"ts":"1676304223727"} 2023-02-13 16:03:43,727 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304223727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223727"}]},"ts":"1676304223727"} 2023-02-13 16:03:43,727 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223727"}]},"ts":"1676304223727"} 2023-02-13 16:03:43,727 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,j\\xCA\\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223727"}]},"ts":"1676304223727"} 2023-02-13 16:03:43,727 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,g\\xA7\\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223727"}]},"ts":"1676304223727"} 2023-02-13 16:03:43,728 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,m\\xED\\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223727"}]},"ts":"1676304223727"} 2023-02-13 16:03:43,728 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223727"}]},"ts":"1676304223727"} 2023-02-13 16:03:43,728 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223727"}]},"ts":"1676304223727"} 2023-02-13 16:03:43,728 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,q\\x11\\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223727"}]},"ts":"1676304223727"} 2023-02-13 16:03:43,728 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304223727"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304223727"}]},"ts":"1676304223727"} 2023-02-13 16:03:43,731 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 16:03:43,732 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:03:43,732 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304223732"}]},"ts":"1676304223732"} 2023-02-13 16:03:43,734 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 16:03:43,739 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:43,748 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:43,748 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:43,748 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:43,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d49e5e9dc9c8c646aa9e4a6b3553ba1f, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=121d5e32312bbfb25df57897b25d68c2, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4a20bf98bd5b018f1a28063cb96011e2, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3fbd1828b59558a2ffca1be9af02f6e2, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b540b745c9d2f8a61806ca62f0ac6f9e, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5cc0251f2a699eafc3b80793e4405fde, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0b2a1bd67c080415da09adb5d6485652, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ba17dfff6d375413082eb96ecdbfe764, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=397270e8716ff8c1be713a2aac73d948, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bee40e2fed40d46b5f11b2d0c6c6c9fa, ASSIGN}] 2023-02-13 16:03:43,751 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=121d5e32312bbfb25df57897b25d68c2, ASSIGN 2023-02-13 16:03:43,752 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=3fbd1828b59558a2ffca1be9af02f6e2, ASSIGN 2023-02-13 16:03:43,752 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=d49e5e9dc9c8c646aa9e4a6b3553ba1f, ASSIGN 2023-02-13 16:03:43,752 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=4a20bf98bd5b018f1a28063cb96011e2, ASSIGN 2023-02-13 16:03:43,753 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=121d5e32312bbfb25df57897b25d68c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35057,1676304222167; forceNewPlan=false, retain=false 2023-02-13 16:03:43,753 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=3fbd1828b59558a2ffca1be9af02f6e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35057,1676304222167; forceNewPlan=false, retain=false 2023-02-13 16:03:43,754 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=d49e5e9dc9c8c646aa9e4a6b3553ba1f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39793,1676304222126; forceNewPlan=false, retain=false 2023-02-13 16:03:43,754 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=4a20bf98bd5b018f1a28063cb96011e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35057,1676304222167; forceNewPlan=false, retain=false 2023-02-13 16:03:43,755 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=bee40e2fed40d46b5f11b2d0c6c6c9fa, ASSIGN 2023-02-13 16:03:43,755 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=397270e8716ff8c1be713a2aac73d948, ASSIGN 2023-02-13 16:03:43,755 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=ba17dfff6d375413082eb96ecdbfe764, ASSIGN 2023-02-13 16:03:43,755 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=0b2a1bd67c080415da09adb5d6485652, ASSIGN 2023-02-13 16:03:43,755 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=5cc0251f2a699eafc3b80793e4405fde, ASSIGN 2023-02-13 16:03:43,755 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=bee40e2fed40d46b5f11b2d0c6c6c9fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39793,1676304222126; forceNewPlan=false, retain=false 2023-02-13 16:03:43,756 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=397270e8716ff8c1be713a2aac73d948, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39793,1676304222126; forceNewPlan=false, retain=false 2023-02-13 16:03:43,756 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=ba17dfff6d375413082eb96ecdbfe764, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35057,1676304222167; forceNewPlan=false, retain=false 2023-02-13 16:03:43,757 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=0b2a1bd67c080415da09adb5d6485652, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35057,1676304222167; forceNewPlan=false, retain=false 2023-02-13 16:03:43,757 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=5cc0251f2a699eafc3b80793e4405fde, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39793,1676304222126; forceNewPlan=false, retain=false 2023-02-13 16:03:43,757 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b540b745c9d2f8a61806ca62f0ac6f9e, ASSIGN 2023-02-13 16:03:43,758 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b540b745c9d2f8a61806ca62f0ac6f9e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39793,1676304222126; forceNewPlan=false, retain=false 2023-02-13 16:03:43,821 INFO [RS:0;jenkins-hbase4:39793] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39793%2C1676304222126, suffix=, logDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/WALs/jenkins-hbase4.apache.org,39793,1676304222126, archiveDir=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/oldWALs, maxLogs=32 2023-02-13 16:03:43,842 DEBUG [RS-EventLoopGroup-8-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44155,DS-e08ca434-0cd3-431c-877a-0504e5afd404,DISK] 2023-02-13 16:03:43,844 DEBUG [RS-EventLoopGroup-8-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45105,DS-450ff5ca-b69e-4e86-8b34-a4b6ca0db05f,DISK] 2023-02-13 16:03:43,846 INFO [RS:0;jenkins-hbase4:39793] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/WALs/jenkins-hbase4.apache.org,39793,1676304222126/jenkins-hbase4.apache.org%2C39793%2C1676304222126.1676304223822 2023-02-13 16:03:43,847 DEBUG [RS:0;jenkins-hbase4:39793] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44155,DS-e08ca434-0cd3-431c-877a-0504e5afd404,DISK], DatanodeInfoWithStorage[127.0.0.1:45105,DS-450ff5ca-b69e-4e86-8b34-a4b6ca0db05f,DISK]] 2023-02-13 16:03:43,903 INFO [jenkins-hbase4:40869] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 16:03:43,907 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b540b745c9d2f8a61806ca62f0ac6f9e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:43,907 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=397270e8716ff8c1be713a2aac73d948, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:43,907 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5cc0251f2a699eafc3b80793e4405fde, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:43,908 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223907"}]},"ts":"1676304223907"} 2023-02-13 16:03:43,907 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d49e5e9dc9c8c646aa9e4a6b3553ba1f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:43,908 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,m\\xED\\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223907"}]},"ts":"1676304223907"} 2023-02-13 16:03:43,908 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304223907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223907"}]},"ts":"1676304223907"} 2023-02-13 16:03:43,907 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=bee40e2fed40d46b5f11b2d0c6c6c9fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:43,908 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,j\\xCA\\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223907"}]},"ts":"1676304223907"} 2023-02-13 16:03:43,908 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304223907"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223907"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223907"}]},"ts":"1676304223907"} 2023-02-13 16:03:43,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=19, state=RUNNABLE; OpenRegionProcedure 397270e8716ff8c1be713a2aac73d948, server=jenkins-hbase4.apache.org,39793,1676304222126}] 2023-02-13 16:03:43,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=16, state=RUNNABLE; OpenRegionProcedure 5cc0251f2a699eafc3b80793e4405fde, server=jenkins-hbase4.apache.org,39793,1676304222126}] 2023-02-13 16:03:43,912 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=11, state=RUNNABLE; OpenRegionProcedure d49e5e9dc9c8c646aa9e4a6b3553ba1f, server=jenkins-hbase4.apache.org,39793,1676304222126}] 2023-02-13 16:03:43,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=15, state=RUNNABLE; OpenRegionProcedure b540b745c9d2f8a61806ca62f0ac6f9e, server=jenkins-hbase4.apache.org,39793,1676304222126}] 2023-02-13 16:03:43,917 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure bee40e2fed40d46b5f11b2d0c6c6c9fa, server=jenkins-hbase4.apache.org,39793,1676304222126}] 2023-02-13 16:03:43,918 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0b2a1bd67c080415da09adb5d6485652, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:43,918 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,q\\x11\\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223918"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223918"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223918"}]},"ts":"1676304223918"} 2023-02-13 16:03:43,919 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3fbd1828b59558a2ffca1be9af02f6e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:43,919 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,g\\xA7\\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223919"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223919"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223919"}]},"ts":"1676304223919"} 2023-02-13 16:03:43,921 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=121d5e32312bbfb25df57897b25d68c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:43,921 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223920"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223920"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223920"}]},"ts":"1676304223920"} 2023-02-13 16:03:43,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=17, state=RUNNABLE; OpenRegionProcedure 0b2a1bd67c080415da09adb5d6485652, server=jenkins-hbase4.apache.org,35057,1676304222167}] 2023-02-13 16:03:43,924 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ba17dfff6d375413082eb96ecdbfe764, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:43,924 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223924"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223924"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223924"}]},"ts":"1676304223924"} 2023-02-13 16:03:43,924 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4a20bf98bd5b018f1a28063cb96011e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:43,924 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,d\\x84\\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304223924"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304223924"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304223924"}]},"ts":"1676304223924"} 2023-02-13 16:03:43,926 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=14, state=RUNNABLE; OpenRegionProcedure 3fbd1828b59558a2ffca1be9af02f6e2, server=jenkins-hbase4.apache.org,35057,1676304222167}] 2023-02-13 16:03:43,927 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=12, state=RUNNABLE; OpenRegionProcedure 121d5e32312bbfb25df57897b25d68c2, server=jenkins-hbase4.apache.org,35057,1676304222167}] 2023-02-13 16:03:43,928 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=18, state=RUNNABLE; OpenRegionProcedure ba17dfff6d375413082eb96ecdbfe764, server=jenkins-hbase4.apache.org,35057,1676304222167}] 2023-02-13 16:03:43,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:43,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=13, state=RUNNABLE; OpenRegionProcedure 4a20bf98bd5b018f1a28063cb96011e2, server=jenkins-hbase4.apache.org,35057,1676304222167}] 2023-02-13 16:03:44,062 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,063 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:03:44,066 INFO [RS-EventLoopGroup-7-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56180, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:03:44,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:44,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 397270e8716ff8c1be713a2aac73d948, NAME => 'testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 16:03:44,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:44,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:44,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:44,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:44,072 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:44,073 DEBUG [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f1 2023-02-13 16:03:44,073 DEBUG [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f1 2023-02-13 16:03:44,074 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 397270e8716ff8c1be713a2aac73d948 columnFamilyName f1 2023-02-13 16:03:44,074 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] regionserver.HStore(310): Store=397270e8716ff8c1be713a2aac73d948/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,074 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:44,075 DEBUG [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f2 2023-02-13 16:03:44,075 DEBUG [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f2 2023-02-13 16:03:44,076 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 397270e8716ff8c1be713a2aac73d948 columnFamilyName f2 2023-02-13 16:03:44,076 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] regionserver.HStore(310): Store=397270e8716ff8c1be713a2aac73d948/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:44,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:44,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:44,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:44,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 121d5e32312bbfb25df57897b25d68c2, NAME => 'testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 16:03:44,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:44,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:44,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:44,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:44,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:44,082 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:44,084 DEBUG [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f1 2023-02-13 16:03:44,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:44,084 DEBUG [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f1 2023-02-13 16:03:44,085 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 121d5e32312bbfb25df57897b25d68c2 columnFamilyName f1 2023-02-13 16:03:44,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 397270e8716ff8c1be713a2aac73d948; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61712416, jitterRate=-0.0804133415222168}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:44,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 397270e8716ff8c1be713a2aac73d948: Running coprocessor pre-open hook at 1676304224071Writing region info on filesystem at 1676304224071Initializing all the Stores at 1676304224072 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224072Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224072Cleaning up temporary data from old regions at 1676304224078 (+6 ms)Cleaning up detritus from prior splits at 1676304224079 (+1 ms)Running coprocessor post-open hooks at 1676304224085 (+6 ms)Region opened successfully at 1676304224085 2023-02-13 16:03:44,085 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] regionserver.HStore(310): Store=121d5e32312bbfb25df57897b25d68c2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,085 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:44,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948., pid=21, masterSystemTime=1676304224062 2023-02-13 16:03:44,088 DEBUG [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f2 2023-02-13 16:03:44,088 DEBUG [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f2 2023-02-13 16:03:44,089 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 121d5e32312bbfb25df57897b25d68c2 columnFamilyName f2 2023-02-13 16:03:44,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:44,090 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] regionserver.HStore(310): Store=121d5e32312bbfb25df57897b25d68c2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,090 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=397270e8716ff8c1be713a2aac73d948, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,090 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304224090"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304224090"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304224090"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304224090"}]},"ts":"1676304224090"} 2023-02-13 16:03:44,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:44,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:44,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:44,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=19 2023-02-13 16:03:44,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=19, state=SUCCESS; OpenRegionProcedure 397270e8716ff8c1be713a2aac73d948, server=jenkins-hbase4.apache.org,39793,1676304222126 in 182 msec 2023-02-13 16:03:44,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:44,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:44,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d49e5e9dc9c8c646aa9e4a6b3553ba1f, NAME => 'testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 16:03:44,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:44,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:44,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:44,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:44,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:44,097 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:44,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=397270e8716ff8c1be713a2aac73d948, ASSIGN in 346 msec 2023-02-13 16:03:44,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:44,098 DEBUG [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f/f1 2023-02-13 16:03:44,099 DEBUG [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f/f1 2023-02-13 16:03:44,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 121d5e32312bbfb25df57897b25d68c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73634217, jitterRate=0.09723533689975739}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:44,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 121d5e32312bbfb25df57897b25d68c2: Running coprocessor pre-open hook at 1676304224081Writing region info on filesystem at 1676304224081Initializing all the Stores at 1676304224082 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224082Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224082Cleaning up temporary data from old regions at 1676304224092 (+10 ms)Cleaning up detritus from prior splits at 1676304224093 (+1 ms)Running coprocessor post-open hooks at 1676304224099 (+6 ms)Region opened successfully at 1676304224099 2023-02-13 16:03:44,099 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d49e5e9dc9c8c646aa9e4a6b3553ba1f columnFamilyName f1 2023-02-13 16:03:44,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2., pid=28, masterSystemTime=1676304224077 2023-02-13 16:03:44,099 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] regionserver.HStore(310): Store=d49e5e9dc9c8c646aa9e4a6b3553ba1f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,100 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:44,101 DEBUG [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f/f2 2023-02-13 16:03:44,101 DEBUG [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f/f2 2023-02-13 16:03:44,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:44,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:44,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:44,101 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d49e5e9dc9c8c646aa9e4a6b3553ba1f columnFamilyName f2 2023-02-13 16:03:44,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ba17dfff6d375413082eb96ecdbfe764, NAME => 'testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 16:03:44,101 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=121d5e32312bbfb25df57897b25d68c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:44,102 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304224101"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304224101"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304224101"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304224101"}]},"ts":"1676304224101"} 2023-02-13 16:03:44,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:44,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:44,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:44,102 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] regionserver.HStore(310): Store=d49e5e9dc9c8c646aa9e4a6b3553ba1f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:44,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:44,103 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:44,104 DEBUG [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f1 2023-02-13 16:03:44,105 DEBUG [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f1 2023-02-13 16:03:44,105 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba17dfff6d375413082eb96ecdbfe764 columnFamilyName f1 2023-02-13 16:03:44,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=12 2023-02-13 16:03:44,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=12, state=SUCCESS; OpenRegionProcedure 121d5e32312bbfb25df57897b25d68c2, server=jenkins-hbase4.apache.org,35057,1676304222167 in 176 msec 2023-02-13 16:03:44,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:44,105 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] regionserver.HStore(310): Store=ba17dfff6d375413082eb96ecdbfe764/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,106 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:44,106 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=121d5e32312bbfb25df57897b25d68c2, ASSIGN in 357 msec 2023-02-13 16:03:44,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:44,107 DEBUG [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f2 2023-02-13 16:03:44,107 DEBUG [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f2 2023-02-13 16:03:44,107 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba17dfff6d375413082eb96ecdbfe764 columnFamilyName f2 2023-02-13 16:03:44,108 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] regionserver.HStore(310): Store=ba17dfff6d375413082eb96ecdbfe764/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:44,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:44,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:44,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:44,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d49e5e9dc9c8c646aa9e4a6b3553ba1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72363107, jitterRate=0.07829432189464569}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:44,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d49e5e9dc9c8c646aa9e4a6b3553ba1f: Running coprocessor pre-open hook at 1676304224096Writing region info on filesystem at 1676304224096Initializing all the Stores at 1676304224096Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224096Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224097 (+1 ms)Cleaning up temporary data from old regions at 1676304224104 (+7 ms)Cleaning up detritus from prior splits at 1676304224104Running coprocessor post-open hooks at 1676304224113 (+9 ms)Region opened successfully at 1676304224113 2023-02-13 16:03:44,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f., pid=23, masterSystemTime=1676304224062 2023-02-13 16:03:44,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:44,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:44,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ba17dfff6d375413082eb96ecdbfe764; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73674372, jitterRate=0.09783369302749634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:44,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ba17dfff6d375413082eb96ecdbfe764: Running coprocessor pre-open hook at 1676304224102Writing region info on filesystem at 1676304224102Initializing all the Stores at 1676304224103 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224103Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224103Cleaning up temporary data from old regions at 1676304224112 (+9 ms)Cleaning up detritus from prior splits at 1676304224112Running coprocessor post-open hooks at 1676304224118 (+6 ms)Region opened successfully at 1676304224118 2023-02-13 16:03:44,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764., pid=29, masterSystemTime=1676304224077 2023-02-13 16:03:44,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:44,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:44,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:44,121 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=ba17dfff6d375413082eb96ecdbfe764, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:44,121 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304224121"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304224121"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304224121"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304224121"}]},"ts":"1676304224121"} 2023-02-13 16:03:44,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:44,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3fbd1828b59558a2ffca1be9af02f6e2, NAME => 'testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 16:03:44,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:44,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5cc0251f2a699eafc3b80793e4405fde, NAME => 'testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 16:03:44,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:44,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:44,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:44,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:44,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:44,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:44,123 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d49e5e9dc9c8c646aa9e4a6b3553ba1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:44,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:44,124 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304224123"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304224123"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304224123"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304224123"}]},"ts":"1676304224123"} 2023-02-13 16:03:44,124 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:44,126 DEBUG [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f1 2023-02-13 16:03:44,126 DEBUG [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f1 2023-02-13 16:03:44,126 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fbd1828b59558a2ffca1be9af02f6e2 columnFamilyName f1 2023-02-13 16:03:44,127 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] regionserver.HStore(310): Store=3fbd1828b59558a2ffca1be9af02f6e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,127 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:44,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=18 2023-02-13 16:03:44,128 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=18, state=SUCCESS; OpenRegionProcedure ba17dfff6d375413082eb96ecdbfe764, server=jenkins-hbase4.apache.org,35057,1676304222167 in 197 msec 2023-02-13 16:03:44,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=11 2023-02-13 16:03:44,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=11, state=SUCCESS; OpenRegionProcedure d49e5e9dc9c8c646aa9e4a6b3553ba1f, server=jenkins-hbase4.apache.org,39793,1676304222126 in 214 msec 2023-02-13 16:03:44,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=ba17dfff6d375413082eb96ecdbfe764, ASSIGN in 380 msec 2023-02-13 16:03:44,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=d49e5e9dc9c8c646aa9e4a6b3553ba1f, ASSIGN in 381 msec 2023-02-13 16:03:44,132 DEBUG [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f2 2023-02-13 16:03:44,132 DEBUG [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f2 2023-02-13 16:03:44,132 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fbd1828b59558a2ffca1be9af02f6e2 columnFamilyName f2 2023-02-13 16:03:44,133 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] regionserver.HStore(310): Store=3fbd1828b59558a2ffca1be9af02f6e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,136 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:44,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:44,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:44,137 DEBUG [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f1 2023-02-13 16:03:44,138 DEBUG [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f1 2023-02-13 16:03:44,138 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cc0251f2a699eafc3b80793e4405fde columnFamilyName f1 2023-02-13 16:03:44,139 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] regionserver.HStore(310): Store=5cc0251f2a699eafc3b80793e4405fde/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,139 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:44,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:44,140 DEBUG [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f2 2023-02-13 16:03:44,140 DEBUG [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f2 2023-02-13 16:03:44,141 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cc0251f2a699eafc3b80793e4405fde columnFamilyName f2 2023-02-13 16:03:44,142 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] regionserver.HStore(310): Store=5cc0251f2a699eafc3b80793e4405fde/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:44,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:44,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:44,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:44,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3fbd1828b59558a2ffca1be9af02f6e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68051745, jitterRate=0.014050021767616272}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:44,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3fbd1828b59558a2ffca1be9af02f6e2: Running coprocessor pre-open hook at 1676304224122Writing region info on filesystem at 1676304224122Initializing all the Stores at 1676304224123 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224123Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224124 (+1 ms)Cleaning up temporary data from old regions at 1676304224138 (+14 ms)Cleaning up detritus from prior splits at 1676304224138Running coprocessor post-open hooks at 1676304224146 (+8 ms)Region opened successfully at 1676304224146 2023-02-13 16:03:44,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:44,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2., pid=27, masterSystemTime=1676304224077 2023-02-13 16:03:44,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:44,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:44,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:44,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:44,149 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3fbd1828b59558a2ffca1be9af02f6e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,150 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,g\\xA7\\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304224149"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304224149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304224149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304224149"}]},"ts":"1676304224149"} 2023-02-13 16:03:44,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0b2a1bd67c080415da09adb5d6485652, NAME => 'testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 16:03:44,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:44,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:44,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:44,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:44,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:44,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5cc0251f2a699eafc3b80793e4405fde; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73123028, jitterRate=0.0896180272102356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:44,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5cc0251f2a699eafc3b80793e4405fde: Running coprocessor pre-open hook at 1676304224124Writing region info on filesystem at 1676304224124Initializing all the Stores at 1676304224125 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224125Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224136 (+11 ms)Cleaning up temporary data from old regions at 1676304224145 (+9 ms)Cleaning up detritus from prior splits at 1676304224145Running coprocessor post-open hooks at 1676304224152 (+7 ms)Region opened successfully at 1676304224152 2023-02-13 16:03:44,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde., pid=22, masterSystemTime=1676304224062 2023-02-13 16:03:44,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=14 2023-02-13 16:03:44,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=14, state=SUCCESS; OpenRegionProcedure 3fbd1828b59558a2ffca1be9af02f6e2, server=jenkins-hbase4.apache.org,35057,1676304222167 in 226 msec 2023-02-13 16:03:44,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:44,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:44,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:44,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=3fbd1828b59558a2ffca1be9af02f6e2, ASSIGN in 406 msec 2023-02-13 16:03:44,155 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=5cc0251f2a699eafc3b80793e4405fde, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,155 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,m\\xED\\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304224155"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304224155"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304224155"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304224155"}]},"ts":"1676304224155"} 2023-02-13 16:03:44,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b540b745c9d2f8a61806ca62f0ac6f9e, NAME => 'testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 16:03:44,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:44,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:44,156 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:44,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:44,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:44,158 DEBUG [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f1 2023-02-13 16:03:44,158 DEBUG [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f1 2023-02-13 16:03:44,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=16 2023-02-13 16:03:44,159 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b2a1bd67c080415da09adb5d6485652 columnFamilyName f1 2023-02-13 16:03:44,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=16, state=SUCCESS; OpenRegionProcedure 5cc0251f2a699eafc3b80793e4405fde, server=jenkins-hbase4.apache.org,39793,1676304222126 in 246 msec 2023-02-13 16:03:44,160 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] regionserver.HStore(310): Store=0b2a1bd67c080415da09adb5d6485652/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,160 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:44,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=5cc0251f2a699eafc3b80793e4405fde, ASSIGN in 411 msec 2023-02-13 16:03:44,161 DEBUG [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f2 2023-02-13 16:03:44,161 DEBUG [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f2 2023-02-13 16:03:44,162 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b2a1bd67c080415da09adb5d6485652 columnFamilyName f2 2023-02-13 16:03:44,162 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] regionserver.HStore(310): Store=0b2a1bd67c080415da09adb5d6485652/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,171 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:44,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:44,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:44,172 DEBUG [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f1 2023-02-13 16:03:44,173 DEBUG [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f1 2023-02-13 16:03:44,173 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b540b745c9d2f8a61806ca62f0ac6f9e columnFamilyName f1 2023-02-13 16:03:44,174 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] regionserver.HStore(310): Store=b540b745c9d2f8a61806ca62f0ac6f9e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,174 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:44,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:44,175 DEBUG [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f2 2023-02-13 16:03:44,175 DEBUG [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f2 2023-02-13 16:03:44,176 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b540b745c9d2f8a61806ca62f0ac6f9e columnFamilyName f2 2023-02-13 16:03:44,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:44,176 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] regionserver.HStore(310): Store=b540b745c9d2f8a61806ca62f0ac6f9e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:44,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:44,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:44,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 0b2a1bd67c080415da09adb5d6485652; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70143403, jitterRate=0.04521815478801727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:44,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 0b2a1bd67c080415da09adb5d6485652: Running coprocessor pre-open hook at 1676304224150Writing region info on filesystem at 1676304224150Initializing all the Stores at 1676304224151 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224152 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224156 (+4 ms)Cleaning up temporary data from old regions at 1676304224173 (+17 ms)Cleaning up detritus from prior splits at 1676304224173Running coprocessor post-open hooks at 1676304224179 (+6 ms)Region opened successfully at 1676304224179 2023-02-13 16:03:44,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:44,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652., pid=26, masterSystemTime=1676304224077 2023-02-13 16:03:44,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:44,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:44,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:44,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:44,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4a20bf98bd5b018f1a28063cb96011e2, NAME => 'testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 16:03:44,183 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=0b2a1bd67c080415da09adb5d6485652, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce 4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:44,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:44,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,q\\x11\\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304224183"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304224183"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304224183"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304224183"}]},"ts":"1676304224183"} 2023-02-13 16:03:44,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:44,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:44,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=17 2023-02-13 16:03:44,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=17, state=SUCCESS; OpenRegionProcedure 0b2a1bd67c080415da09adb5d6485652, server=jenkins-hbase4.apache.org,35057,1676304222167 in 264 msec 2023-02-13 16:03:44,188 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=0b2a1bd67c080415da09adb5d6485652, ASSIGN in 439 msec 2023-02-13 16:03:44,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:44,188 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:44,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b540b745c9d2f8a61806ca62f0ac6f9e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60473793, jitterRate=-0.09887026250362396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:44,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b540b745c9d2f8a61806ca62f0ac6f9e: Running coprocessor pre-open hook at 1676304224157Writing region info on filesystem at 1676304224157Initializing all the Stores at 1676304224158 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224158Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224171 (+13 ms)Cleaning up temporary data from old regions at 1676304224179 (+8 ms)Cleaning up detritus from prior splits at 1676304224179Running coprocessor post-open hooks at 1676304224188 (+9 ms)Region opened successfully at 1676304224188 2023-02-13 16:03:44,189 DEBUG [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f1 2023-02-13 16:03:44,189 DEBUG [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f1 2023-02-13 16:03:44,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e., pid=24, masterSystemTime=1676304224062 2023-02-13 16:03:44,190 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a20bf98bd5b018f1a28063cb96011e2 columnFamilyName f1 2023-02-13 16:03:44,191 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] regionserver.HStore(310): Store=4a20bf98bd5b018f1a28063cb96011e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,191 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:44,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:44,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:44,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:44,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bee40e2fed40d46b5f11b2d0c6c6c9fa, NAME => 'testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 16:03:44,192 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=b540b745c9d2f8a61806ca62f0ac6f9e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:44,192 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,j\\xCA\\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304224192"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304224192"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304224192"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304224192"}]},"ts":"1676304224192"} 2023-02-13 16:03:44,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:44,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:44,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:44,193 DEBUG [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f2 2023-02-13 16:03:44,193 DEBUG [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f2 2023-02-13 16:03:44,193 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a20bf98bd5b018f1a28063cb96011e2 columnFamilyName f2 2023-02-13 16:03:44,194 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] regionserver.HStore(310): Store=4a20bf98bd5b018f1a28063cb96011e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,195 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=15 2023-02-13 16:03:44,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=15, state=SUCCESS; OpenRegionProcedure b540b745c9d2f8a61806ca62f0ac6f9e, server=jenkins-hbase4.apache.org,39793,1676304222126 in 280 msec 2023-02-13 16:03:44,196 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:44,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:44,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:44,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b540b745c9d2f8a61806ca62f0ac6f9e, ASSIGN in 448 msec 2023-02-13 16:03:44,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:44,200 DEBUG [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa/f1 2023-02-13 16:03:44,200 DEBUG [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa/f1 2023-02-13 16:03:44,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:44,200 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bee40e2fed40d46b5f11b2d0c6c6c9fa columnFamilyName f1 2023-02-13 16:03:44,201 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] regionserver.HStore(310): Store=bee40e2fed40d46b5f11b2d0c6c6c9fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,201 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:44,202 DEBUG [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa/f2 2023-02-13 16:03:44,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:44,202 DEBUG [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa/f2 2023-02-13 16:03:44,203 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bee40e2fed40d46b5f11b2d0c6c6c9fa columnFamilyName f2 2023-02-13 16:03:44,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4a20bf98bd5b018f1a28063cb96011e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71887258, jitterRate=0.07120361924171448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:44,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4a20bf98bd5b018f1a28063cb96011e2: Running coprocessor pre-open hook at 1676304224184Writing region info on filesystem at 1676304224184Initializing all the Stores at 1676304224185 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224185Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224188 (+3 ms)Cleaning up temporary data from old regions at 1676304224198 (+10 ms)Cleaning up detritus from prior splits at 1676304224198Running coprocessor post-open hooks at 1676304224203 (+5 ms)Region opened successfully at 1676304224203 2023-02-13 16:03:44,203 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] regionserver.HStore(310): Store=bee40e2fed40d46b5f11b2d0c6c6c9fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:44,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2., pid=30, masterSystemTime=1676304224077 2023-02-13 16:03:44,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:44,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:44,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:44,205 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:44,205 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4a20bf98bd5b018f1a28063cb96011e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,206 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,d\\x84\\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.","families":{"info":[{"qualifier":"regioninfo","vlen":57,"tag":[],"timestamp":"1676304224205"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304224205"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304224205"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304224205"}]},"ts":"1676304224205"} 2023-02-13 16:03:44,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:44,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:44,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=13 2023-02-13 16:03:44,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=13, state=SUCCESS; OpenRegionProcedure 4a20bf98bd5b018f1a28063cb96011e2, server=jenkins-hbase4.apache.org,35057,1676304222167 in 277 msec 2023-02-13 16:03:44,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=4a20bf98bd5b018f1a28063cb96011e2, ASSIGN in 461 msec 2023-02-13 16:03:44,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:44,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened bee40e2fed40d46b5f11b2d0c6c6c9fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72617323, jitterRate=0.08208243548870087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:44,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for bee40e2fed40d46b5f11b2d0c6c6c9fa: Running coprocessor pre-open hook at 1676304224192Writing region info on filesystem at 1676304224192Initializing all the Stores at 1676304224193 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224193Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304224196 (+3 ms)Cleaning up temporary data from old regions at 1676304224205 (+9 ms)Cleaning up detritus from prior splits at 1676304224206 (+1 ms)Running coprocessor post-open hooks at 1676304224211 (+5 ms)Region opened successfully at 1676304224211 2023-02-13 16:03:44,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa., pid=25, masterSystemTime=1676304224062 2023-02-13 16:03:44,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:44,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:44,213 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=bee40e2fed40d46b5f11b2d0c6c6c9fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,213 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.","families":{"info":[{"qualifier":"regioninfo","vlen":54,"tag":[],"timestamp":"1676304224213"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304224213"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304224213"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304224213"}]},"ts":"1676304224213"} 2023-02-13 16:03:44,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-13 16:03:44,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure bee40e2fed40d46b5f11b2d0c6c6c9fa, server=jenkins-hbase4.apache.org,39793,1676304222126 in 298 msec 2023-02-13 16:03:44,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=10 2023-02-13 16:03:44,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=bee40e2fed40d46b5f11b2d0c6c6c9fa, ASSIGN in 469 msec 2023-02-13 16:03:44,219 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:03:44,219 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304224219"}]},"ts":"1676304224219"} 2023-02-13 16:03:44,221 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 16:03:44,223 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:03:44,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 603 msec 2023-02-13 16:03:44,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:44,230 INFO [Listener at localhost/44363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 16:03:44,230 DEBUG [Listener at localhost/44363] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 16:03:44,231 INFO [Listener at localhost/44363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:03:44,234 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 16:03:44,235 INFO [Listener at localhost/44363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:03:44,235 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 16:03:44,235 INFO [Listener at localhost/44363] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 16:03:44,288 DEBUG [hconnection-0x3bc9668f-shared-pool-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:44,305 INFO [RS-EventLoopGroup-7-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56184, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:44,314 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39793] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:44,320 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35057] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:44,428 INFO [Listener at localhost/44363] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 16:03:44,429 INFO [Listener at localhost/44363] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 16:03:44,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 16:03:44,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676304224430 (current time:1676304224430). 2023-02-13 16:03:44,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 16:03:44,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] zookeeper.ReadOnlyZKClient(139): Connect 0x49b6d2a1 to 127.0.0.1:57466 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:44,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11aad771, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:44,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:44,445 INFO [RS-EventLoopGroup-8-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42854, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:44,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49b6d2a1 to 127.0.0.1:57466 2023-02-13 16:03:44,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:44,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 16:03:44,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 16:03:44,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 16:03:44,450 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 16:03:44,451 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676304824451 2023-02-13 16:03:44,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 16:03:44,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 16:03:44,453 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 16:03:44,453 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 16:03:44,454 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 16:03:44,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 16:03:44,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 5 msec 2023-02-13 16:03:44,456 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 16:03:44,456 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676304824456 2023-02-13 16:03:44,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,475 INFO [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' 2023-02-13 16:03:44,475 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:44,477 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' 2023-02-13 16:03:44,477 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceAndOfflineHBaseMultiRegion', kicking off acquire phase on members. 2023-02-13 16:03:44,477 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,477 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,480 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:44,480 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:44,480 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:44,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:44,480 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,481 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,481 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,481 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:03:44,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-13 16:03:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,482 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 16:03:44,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 81 2023-02-13 16:03:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,482 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-13 16:03:44,482 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:44,482 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceAndOfflineHBaseMultiRegion from table testWithMapReduce type FLUSH 2023-02-13 16:03:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-13 16:03:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-13 16:03:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39793,1676304222126' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-13 16:03:44,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,483 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' with timeout 300000ms 2023-02-13 16:03:44,484 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:44,484 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'acquire' stage 2023-02-13 16:03:44,484 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally acquired 2023-02-13 16:03:44,484 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35057,1676304222167' joining acquired barrier for procedure (testWithMapReduceAndOfflineHBaseMultiRegion) in zk 2023-02-13 16:03:44,485 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,485 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:44,486 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,486 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,486 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,486 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:44,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39793,1676304222126' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-13 16:03:44,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53120163[Count = 1] remaining members to acquire global barrier 2023-02-13 16:03:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:44,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35057,1676304222167' joining acquired barrier for procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' on coordinator 2023-02-13 16:03:44,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53120163[Count = 0] remaining members to acquire global barrier 2023-02-13 16:03:44,492 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' starting 'in-barrier' execution. 2023-02-13 16:03:44,492 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,492 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,492 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:44,493 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,493 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,494 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-13 16:03:44,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,494 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,494 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' received 'reached' from coordinator. 2023-02-13 16:03:44,494 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:44,494 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. started... 2023-02-13 16:03:44,494 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,494 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:03:44,497 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4a20bf98bd5b018f1a28063cb96011e2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:44,497 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:44,497 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. started... 2023-02-13 16:03:44,497 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:44,497 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. started... 2023-02-13 16:03:44,501 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b540b745c9d2f8a61806ca62f0ac6f9e 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:44,501 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HRegion(2744): Flushing ba17dfff6d375413082eb96ecdbfe764 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:44,512 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 16:03:44,512 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 16:03:44,512 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:44,512 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:44,512 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. started... 2023-02-13 16:03:44,512 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. started... 2023-02-13 16:03:44,513 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 121d5e32312bbfb25df57897b25d68c2 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 16:03:44,520 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 16:03:44,520 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 16:03:44,520 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:44,520 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. started... 2023-02-13 16:03:44,529 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5cc0251f2a699eafc3b80793e4405fde 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:44,529 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for bee40e2fed40d46b5f11b2d0c6c6c9fa: 2023-02-13 16:03:44,529 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,529 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:44,529 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:44,529 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:44,557 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:44,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:03:44,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:44,559 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 16:03:44,632 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/.tmp/f1/430864c194ea4909b68721aea9c08483 2023-02-13 16:03:44,646 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/.tmp/f1/11ff2bf9d6bf452caad8eb2ee8bd6f7a 2023-02-13 16:03:44,651 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. completed. 2023-02-13 16:03:44,652 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:44,652 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:44,652 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 16:03:44,652 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. started... 2023-02-13 16:03:44,655 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 397270e8716ff8c1be713a2aac73d948 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 16:03:44,666 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/.tmp/f1/db2c1c939e804f42bf8f5562ba36f6eb 2023-02-13 16:03:44,667 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/.tmp/f1/ef7991cb7b7b4fceab26c8b03c9661f5 2023-02-13 16:03:44,716 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/.tmp/f1/9c59ff31cd50444cb129a76851bded54 2023-02-13 16:03:44,717 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/.tmp/f2/a15631749e8f420fb8cd89ccb561ec1f 2023-02-13 16:03:44,717 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/.tmp/f2/3454f9659a12497ca7b7b4b5b5c860ca 2023-02-13 16:03:44,727 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/.tmp/f1/430864c194ea4909b68721aea9c08483 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f1/430864c194ea4909b68721aea9c08483 2023-02-13 16:03:44,733 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f1/430864c194ea4909b68721aea9c08483, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:44,740 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/.tmp/f2/a15631749e8f420fb8cd89ccb561ec1f as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f2/a15631749e8f420fb8cd89ccb561ec1f 2023-02-13 16:03:44,743 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/.tmp/f1/11ff2bf9d6bf452caad8eb2ee8bd6f7a as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f1/11ff2bf9d6bf452caad8eb2ee8bd6f7a 2023-02-13 16:03:44,751 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f1/11ff2bf9d6bf452caad8eb2ee8bd6f7a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:44,752 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/.tmp/f2/3454f9659a12497ca7b7b4b5b5c860ca as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f2/3454f9659a12497ca7b7b4b5b5c860ca 2023-02-13 16:03:44,754 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/.tmp/f2/950a3f54a47f47998e7449d5d5cffea8 2023-02-13 16:03:44,755 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/.tmp/f2/53e5dac9ab624a149a296e032c3e6b25 2023-02-13 16:03:44,757 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f2/a15631749e8f420fb8cd89ccb561ec1f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:44,758 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for ba17dfff6d375413082eb96ecdbfe764 in 257ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:44,758 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMapReduce' 2023-02-13 16:03:44,759 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for ba17dfff6d375413082eb96ecdbfe764: 2023-02-13 16:03:44,759 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,759 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:44,759 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f1/430864c194ea4909b68721aea9c08483] hfiles 2023-02-13 16:03:44,759 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f1/430864c194ea4909b68721aea9c08483 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,759 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f2/a15631749e8f420fb8cd89ccb561ec1f] hfiles 2023-02-13 16:03:44,759 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f2/a15631749e8f420fb8cd89ccb561ec1f for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,759 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:44,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:03:44,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:44,761 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 16:03:44,763 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f2/3454f9659a12497ca7b7b4b5b5c860ca, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:44,764 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/.tmp/f1/db2c1c939e804f42bf8f5562ba36f6eb as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f1/db2c1c939e804f42bf8f5562ba36f6eb 2023-02-13 16:03:44,765 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 4a20bf98bd5b018f1a28063cb96011e2 in 268ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:44,773 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4a20bf98bd5b018f1a28063cb96011e2: 2023-02-13 16:03:44,773 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,773 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:44,773 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f1/11ff2bf9d6bf452caad8eb2ee8bd6f7a] hfiles 2023-02-13 16:03:44,773 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f1/11ff2bf9d6bf452caad8eb2ee8bd6f7a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,773 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f2/3454f9659a12497ca7b7b4b5b5c860ca] hfiles 2023-02-13 16:03:44,773 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f2/3454f9659a12497ca7b7b4b5b5c860ca for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,795 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/.tmp/f1/ef7991cb7b7b4fceab26c8b03c9661f5 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f1/ef7991cb7b7b4fceab26c8b03c9661f5 2023-02-13 16:03:44,801 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f1/ef7991cb7b7b4fceab26c8b03c9661f5, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:44,802 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/.tmp/f2/53e5dac9ab624a149a296e032c3e6b25 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f2/53e5dac9ab624a149a296e032c3e6b25 2023-02-13 16:03:44,805 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f1/db2c1c939e804f42bf8f5562ba36f6eb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:44,807 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/.tmp/f2/950a3f54a47f47998e7449d5d5cffea8 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f2/950a3f54a47f47998e7449d5d5cffea8 2023-02-13 16:03:44,810 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f2/53e5dac9ab624a149a296e032c3e6b25, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:44,811 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for b540b745c9d2f8a61806ca62f0ac6f9e in 310ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:44,811 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b540b745c9d2f8a61806ca62f0ac6f9e: 2023-02-13 16:03:44,811 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,811 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:44,811 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f1/ef7991cb7b7b4fceab26c8b03c9661f5] hfiles 2023-02-13 16:03:44,811 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f1/ef7991cb7b7b4fceab26c8b03c9661f5 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,811 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f2/53e5dac9ab624a149a296e032c3e6b25] hfiles 2023-02-13 16:03:44,811 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f2/53e5dac9ab624a149a296e032c3e6b25 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,812 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/.tmp/f2/70e2f4b0528f480e9c7a97c961cbff3d 2023-02-13 16:03:44,817 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f2/950a3f54a47f47998e7449d5d5cffea8, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:44,818 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5cc0251f2a699eafc3b80793e4405fde in 289ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:44,818 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5cc0251f2a699eafc3b80793e4405fde: 2023-02-13 16:03:44,818 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,818 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:44,818 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f1/db2c1c939e804f42bf8f5562ba36f6eb] hfiles 2023-02-13 16:03:44,818 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f1/db2c1c939e804f42bf8f5562ba36f6eb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,818 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f2/950a3f54a47f47998e7449d5d5cffea8] hfiles 2023-02-13 16:03:44,818 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f2/950a3f54a47f47998e7449d5d5cffea8 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,834 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/.tmp/f1/9c59ff31cd50444cb129a76851bded54 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f1/9c59ff31cd50444cb129a76851bded54 2023-02-13 16:03:44,840 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f1/9c59ff31cd50444cb129a76851bded54, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:44,846 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/.tmp/f2/70e2f4b0528f480e9c7a97c961cbff3d as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f2/70e2f4b0528f480e9c7a97c961cbff3d 2023-02-13 16:03:44,868 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. completed. 2023-02-13 16:03:44,868 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:44,868 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:44,868 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 16:03:44,868 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. started... 2023-02-13 16:03:44,869 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 3fbd1828b59558a2ffca1be9af02f6e2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:44,871 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f2/70e2f4b0528f480e9c7a97c961cbff3d, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:44,875 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 397270e8716ff8c1be713a2aac73d948 in 220ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:44,875 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 397270e8716ff8c1be713a2aac73d948: 2023-02-13 16:03:44,875 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,875 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:44,875 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f1/9c59ff31cd50444cb129a76851bded54] hfiles 2023-02-13 16:03:44,875 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f1/9c59ff31cd50444cb129a76851bded54 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,875 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f2/70e2f4b0528f480e9c7a97c961cbff3d] hfiles 2023-02-13 16:03:44,876 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f2/70e2f4b0528f480e9c7a97c961cbff3d for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,896 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. completed. 2023-02-13 16:03:44,896 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:44,896 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:44,896 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. started... 2023-02-13 16:03:44,896 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 16:03:44,896 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 0b2a1bd67c080415da09adb5d6485652 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:44,905 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. completed. 2023-02-13 16:03:44,905 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:44,905 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:44,905 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. started... 2023-02-13 16:03:44,905 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for d49e5e9dc9c8c646aa9e4a6b3553ba1f: 2023-02-13 16:03:44,905 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,905 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:44,905 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 16:03:44,905 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:44,905 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:44,907 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. completed. 2023-02-13 16:03:44,907 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:44,907 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 16:03:44,944 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. completed. 2023-02-13 16:03:44,944 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:44,944 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 16:03:44,954 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. completed. 2023-02-13 16:03:44,954 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:44,954 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 16:03:44,954 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 16:03:44,954 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,956 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/.tmp/f1/41925e0f97654f9d9d8b9d9b862279f9 2023-02-13 16:03:44,956 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-13 16:03:44,956 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,39793,1676304222126' in zk 2023-02-13 16:03:44,960 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:44,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:44,960 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-13 16:03:44,960 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:44,960 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-13 16:03:44,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:44,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:44,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:44,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:44,964 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/.tmp/f1/dcbd1ab9005d4382a0e9146db8db9b7a 2023-02-13 16:03:44,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:44,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:44,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,39793,1676304222126': 2023-02-13 16:03:44,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39793,1676304222126' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 16:03:44,984 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/.tmp/f2/a73391bf12eb4d6592c233775c347dd0 2023-02-13 16:03:44,990 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/.tmp/f1/41925e0f97654f9d9d8b9d9b862279f9 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f1/41925e0f97654f9d9d8b9d9b862279f9 2023-02-13 16:03:44,996 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f1/41925e0f97654f9d9d8b9d9b862279f9, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:44,997 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/.tmp/f2/a73391bf12eb4d6592c233775c347dd0 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f2/a73391bf12eb4d6592c233775c347dd0 2023-02-13 16:03:45,010 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f2/a73391bf12eb4d6592c233775c347dd0, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:45,011 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3fbd1828b59558a2ffca1be9af02f6e2 in 143ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:45,016 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 3fbd1828b59558a2ffca1be9af02f6e2: 2023-02-13 16:03:45,016 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,016 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:45,016 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f1/41925e0f97654f9d9d8b9d9b862279f9] hfiles 2023-02-13 16:03:45,016 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f1/41925e0f97654f9d9d8b9d9b862279f9 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,016 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f2/a73391bf12eb4d6592c233775c347dd0] hfiles 2023-02-13 16:03:45,016 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f2/a73391bf12eb4d6592c233775c347dd0 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,017 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/.tmp/f2/e9e9d806cf8f4b9792ac5158bdfd3dbb 2023-02-13 16:03:45,023 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/.tmp/f1/dcbd1ab9005d4382a0e9146db8db9b7a as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f1/dcbd1ab9005d4382a0e9146db8db9b7a 2023-02-13 16:03:45,027 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. completed. 2023-02-13 16:03:45,027 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:45,027 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 16:03:45,030 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f1/dcbd1ab9005d4382a0e9146db8db9b7a, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:45,031 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/.tmp/f2/e9e9d806cf8f4b9792ac5158bdfd3dbb as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f2/e9e9d806cf8f4b9792ac5158bdfd3dbb 2023-02-13 16:03:45,036 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/.tmp/f1/39849fadaa6a4023889a62bee66e49da 2023-02-13 16:03:45,036 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f2/e9e9d806cf8f4b9792ac5158bdfd3dbb, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:45,037 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 0b2a1bd67c080415da09adb5d6485652 in 141ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:45,038 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0b2a1bd67c080415da09adb5d6485652: 2023-02-13 16:03:45,038 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,038 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:45,038 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f1/dcbd1ab9005d4382a0e9146db8db9b7a] hfiles 2023-02-13 16:03:45,038 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f1/dcbd1ab9005d4382a0e9146db8db9b7a for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,038 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f2/e9e9d806cf8f4b9792ac5158bdfd3dbb] hfiles 2023-02-13 16:03:45,038 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f2/e9e9d806cf8f4b9792ac5158bdfd3dbb for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,289 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:45,291 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 16:03:45,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:03:45,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:45,292 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 16:03:45,303 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. completed. 2023-02-13 16:03:45,303 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:45,303 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 16:03:45,706 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/.tmp/f2/18f61dd517a14855a2f76d3e837b8181 2023-02-13 16:03:45,713 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/.tmp/f1/39849fadaa6a4023889a62bee66e49da as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f1/39849fadaa6a4023889a62bee66e49da 2023-02-13 16:03:45,717 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f1/39849fadaa6a4023889a62bee66e49da, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:45,718 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/.tmp/f2/18f61dd517a14855a2f76d3e837b8181 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f2/18f61dd517a14855a2f76d3e837b8181 2023-02-13 16:03:45,723 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f2/18f61dd517a14855a2f76d3e837b8181, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:45,724 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 121d5e32312bbfb25df57897b25d68c2 in 1211ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:45,724 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 121d5e32312bbfb25df57897b25d68c2: 2023-02-13 16:03:45,724 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.' region-info for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,724 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:45,725 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f1/39849fadaa6a4023889a62bee66e49da] hfiles 2023-02-13 16:03:45,725 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f1/39849fadaa6a4023889a62bee66e49da for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,725 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f2/18f61dd517a14855a2f76d3e837b8181] hfiles 2023-02-13 16:03:45,725 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f2/18f61dd517a14855a2f76d3e837b8181 for snapshot=testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,731 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. completed. 2023-02-13 16:03:45,731 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:45,731 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 16:03:45,731 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 16:03:45,731 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,731 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' locally completed 2023-02-13 16:03:45,731 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed for member 'jenkins-hbase4.apache.org,35057,1676304222167' in zk 2023-02-13 16:03:45,733 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' has notified controller of completion 2023-02-13 16:03:45,733 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,733 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:45,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:45,733 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceAndOfflineHBaseMultiRegion' completed. 2023-02-13 16:03:45,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:45,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:45,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' member 'jenkins-hbase4.apache.org,35057,1676304222167': 2023-02-13 16:03:45,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35057,1676304222167' released barrier for procedure'testWithMapReduceAndOfflineHBaseMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 16:03:45,737 INFO [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceAndOfflineHBaseMultiRegion' execution completed 2023-02-13 16:03:45,737 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:03:45,737 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:03:45,737 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,737 INFO [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceAndOfflineHBaseMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 16:03:45,739 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,739 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,739 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:45,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,739 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,739 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:45,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:45,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:45,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:45,740 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,740 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:45,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,742 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:45,742 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:45,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,748 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:45,748 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:45,748 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:45,748 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:45,748 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,748 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:45,748 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:45,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:45,749 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:45,748 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:45,749 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,750 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:45,750 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:45,750 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:45,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:45,750 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,750 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion to hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.hbase-snapshot/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,793 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:45,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:03:45,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:45,794 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-13 16:03:45,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed 2023-02-13 16:03:45,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,805 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/.hbase-snapshot/.tmp/testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:45,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceAndOfflineHBaseMultiRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676304224452Consolidate snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676304225750 (+1298 ms)Loading Region manifests for testWithMapReduceAndOfflineHBaseMultiRegion at 1676304225750Writing data manifest for testWithMapReduceAndOfflineHBaseMultiRegion at 1676304225756 (+6 ms)Verifying snapshot: testWithMapReduceAndOfflineHBaseMultiRegion at 1676304225765 (+9 ms)Snapshot testWithMapReduceAndOfflineHBaseMultiRegion of table testWithMapReduce completed at 1676304225805 (+40 ms) 2023-02-13 16:03:45,807 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 16:03:45,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 1.3540 sec 2023-02-13 16:03:46,795 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:46,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:03:46,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceAndOfflineHBaseMultiRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 16:03:46,796 INFO [Listener at localhost/44363] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 16:03:46,801 INFO [Listener at localhost/44363] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 16:03:46,811 INFO [Listener at localhost/44363] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 16:03:46,860 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39793] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6760 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:46,871 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35057] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10816 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:46,971 INFO [Listener at localhost/44363] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 16:03:46,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 16:03:46,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 16:03:46,982 INFO [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 16:03:46,982 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:46,984 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 16:03:46,984 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 16:03:46,984 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:46,984 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:46,986 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:46,986 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:46,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:46,986 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:46,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:46,986 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:46,986 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:46,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:46,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:46,987 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:46,987 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:03:46,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:03:46,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:46,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:46,987 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 16:03:46,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 16:03:46,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:03:46,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:46,988 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 16:03:46,988 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 16:03:46,988 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:46,989 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 16:03:46,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 16:03:46,989 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:46,989 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. started... 2023-02-13 16:03:46,989 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 16:03:46,989 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:46,990 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4a20bf98bd5b018f1a28063cb96011e2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:46,994 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 16:03:46,994 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:46,996 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. started... 2023-02-13 16:03:46,996 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:46,996 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:46,996 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ba17dfff6d375413082eb96ecdbfe764 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:46,995 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 16:03:46,996 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 16:03:46,996 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. started... 2023-02-13 16:03:46,996 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. started... 2023-02-13 16:03:46,997 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:46,997 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. started... 2023-02-13 16:03:46,996 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:46,996 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 16:03:46,997 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 16:03:46,997 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. started... 2023-02-13 16:03:46,997 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for bee40e2fed40d46b5f11b2d0c6c6c9fa: 2023-02-13 16:03:46,997 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5cc0251f2a699eafc3b80793e4405fde 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:46,997 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:47,004 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:47,004 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 16:03:47,004 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. started... 2023-02-13 16:03:47,004 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 121d5e32312bbfb25df57897b25d68c2 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 16:03:47,005 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 397270e8716ff8c1be713a2aac73d948 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 16:03:47,005 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b540b745c9d2f8a61806ca62f0ac6f9e 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:47,044 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/.tmp/f1/089c1519f8f240fa8e5d49b80caf3b11 2023-02-13 16:03:47,057 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/.tmp/f1/0d456bb74555406bbbe71a33f0d048bc 2023-02-13 16:03:47,063 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/.tmp/f1/fbc00bc6b38049d8b4595c2350bd6029 2023-02-13 16:03:47,068 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/.tmp/f1/632fc610722d4cd1b1e1b620d0e1e3ca 2023-02-13 16:03:47,086 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/.tmp/f1/bda05997c9bc4569acb807fffc62c3ef 2023-02-13 16:03:47,090 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/.tmp/f1/d76567a958394673a47c2f5b1cc6a847 2023-02-13 16:03:47,105 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/.tmp/f2/f5f958aa700545fda778c5bda935459e 2023-02-13 16:03:47,111 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/.tmp/f1/089c1519f8f240fa8e5d49b80caf3b11 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f1/089c1519f8f240fa8e5d49b80caf3b11 2023-02-13 16:03:47,128 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/.tmp/f2/ebdd3fe6b26b4f448241b9e8ad7d158c 2023-02-13 16:03:47,129 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/.tmp/f2/491083e996014c4ca8fb1c7782136061 2023-02-13 16:03:47,130 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f1/089c1519f8f240fa8e5d49b80caf3b11, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,131 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/.tmp/f2/6822d6fe49314eb38cd47672b651c5a7 2023-02-13 16:03:47,131 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/.tmp/f2/f5f958aa700545fda778c5bda935459e as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f2/f5f958aa700545fda778c5bda935459e 2023-02-13 16:03:47,136 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/.tmp/f1/632fc610722d4cd1b1e1b620d0e1e3ca as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f1/632fc610722d4cd1b1e1b620d0e1e3ca 2023-02-13 16:03:47,136 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/.tmp/f1/0d456bb74555406bbbe71a33f0d048bc as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f1/0d456bb74555406bbbe71a33f0d048bc 2023-02-13 16:03:47,140 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/.tmp/f1/fbc00bc6b38049d8b4595c2350bd6029 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f1/fbc00bc6b38049d8b4595c2350bd6029 2023-02-13 16:03:47,141 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f2/f5f958aa700545fda778c5bda935459e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,142 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 4a20bf98bd5b018f1a28063cb96011e2 in 153ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:47,142 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4a20bf98bd5b018f1a28063cb96011e2: 2023-02-13 16:03:47,143 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:47,144 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 16:03:47,144 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:47,144 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. started... 2023-02-13 16:03:47,144 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3fbd1828b59558a2ffca1be9af02f6e2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:47,144 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f1/0d456bb74555406bbbe71a33f0d048bc, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,150 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/.tmp/f2/491083e996014c4ca8fb1c7782136061 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f2/491083e996014c4ca8fb1c7782136061 2023-02-13 16:03:47,152 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f1/fbc00bc6b38049d8b4595c2350bd6029, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,152 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f1/632fc610722d4cd1b1e1b620d0e1e3ca, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:47,153 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/.tmp/f2/6822d6fe49314eb38cd47672b651c5a7 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f2/6822d6fe49314eb38cd47672b651c5a7 2023-02-13 16:03:47,153 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/.tmp/f2/ebdd3fe6b26b4f448241b9e8ad7d158c as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f2/ebdd3fe6b26b4f448241b9e8ad7d158c 2023-02-13 16:03:47,159 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f2/491083e996014c4ca8fb1c7782136061, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,160 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for b540b745c9d2f8a61806ca62f0ac6f9e in 155ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:47,160 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b540b745c9d2f8a61806ca62f0ac6f9e: 2023-02-13 16:03:47,160 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:47,160 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:47,160 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 16:03:47,160 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. started... 2023-02-13 16:03:47,161 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d49e5e9dc9c8c646aa9e4a6b3553ba1f: 2023-02-13 16:03:47,161 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:47,161 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 16:03:47,163 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/.tmp/f2/ee51ca6239af4c039783cc714a8e0d43 2023-02-13 16:03:47,166 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f2/6822d6fe49314eb38cd47672b651c5a7, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,167 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for ba17dfff6d375413082eb96ecdbfe764 in 171ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:47,168 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ba17dfff6d375413082eb96ecdbfe764: 2023-02-13 16:03:47,168 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:47,168 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:47,168 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. started... 2023-02-13 16:03:47,168 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 16:03:47,168 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 0b2a1bd67c080415da09adb5d6485652 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:47,172 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/.tmp/f2/8f806bd979974c638818cf5f9a5e5d88 2023-02-13 16:03:47,188 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/.tmp/f1/bda05997c9bc4569acb807fffc62c3ef as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f1/bda05997c9bc4569acb807fffc62c3ef 2023-02-13 16:03:47,190 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/.tmp/f1/d76567a958394673a47c2f5b1cc6a847 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f1/d76567a958394673a47c2f5b1cc6a847 2023-02-13 16:03:47,196 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f1/bda05997c9bc4569acb807fffc62c3ef, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,196 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f1/d76567a958394673a47c2f5b1cc6a847, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:47,197 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/.tmp/f2/ee51ca6239af4c039783cc714a8e0d43 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f2/ee51ca6239af4c039783cc714a8e0d43 2023-02-13 16:03:47,197 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/.tmp/f2/8f806bd979974c638818cf5f9a5e5d88 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f2/8f806bd979974c638818cf5f9a5e5d88 2023-02-13 16:03:47,204 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f2/8f806bd979974c638818cf5f9a5e5d88, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:47,205 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 397270e8716ff8c1be713a2aac73d948 in 201ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:47,205 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 397270e8716ff8c1be713a2aac73d948: 2023-02-13 16:03:47,205 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:47,205 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 16:03:47,211 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/.tmp/f1/e4e1ab0e2bb9437b9780524222f505e9 2023-02-13 16:03:47,211 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f2/ebdd3fe6b26b4f448241b9e8ad7d158c, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:47,213 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 121d5e32312bbfb25df57897b25d68c2 in 208ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:47,213 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 121d5e32312bbfb25df57897b25d68c2: 2023-02-13 16:03:47,213 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:47,213 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 16:03:47,223 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f2/ee51ca6239af4c039783cc714a8e0d43, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,224 INFO [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5cc0251f2a699eafc3b80793e4405fde in 227ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:47,224 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5cc0251f2a699eafc3b80793e4405fde: 2023-02-13 16:03:47,224 DEBUG [rs(jenkins-hbase4.apache.org,39793,1676304222126)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:47,224 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 16:03:47,225 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 16:03:47,225 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,228 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 16:03:47,228 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39793,1676304222126' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 16:03:47,230 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,230 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:47,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:47,230 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,230 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:47,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:47,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:47,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:47,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:47,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39793,1676304222126' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 16:03:47,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@572d8fd9[Count = 1] remaining members to acquire global barrier 2023-02-13 16:03:47,236 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/.tmp/f1/4f3ad2ff707f4a92bffec5679230bad9 2023-02-13 16:03:47,240 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/.tmp/f2/2dc998fb5e6649fd8b0cb965ef2c1a08 2023-02-13 16:03:47,247 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/.tmp/f1/e4e1ab0e2bb9437b9780524222f505e9 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f1/e4e1ab0e2bb9437b9780524222f505e9 2023-02-13 16:03:47,254 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f1/e4e1ab0e2bb9437b9780524222f505e9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,255 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/.tmp/f2/2dc998fb5e6649fd8b0cb965ef2c1a08 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f2/2dc998fb5e6649fd8b0cb965ef2c1a08 2023-02-13 16:03:47,261 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f2/2dc998fb5e6649fd8b0cb965ef2c1a08, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,262 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3fbd1828b59558a2ffca1be9af02f6e2 in 118ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:47,262 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/.tmp/f2/12e77f4ca14a4cf2977d5773410ef5a2 2023-02-13 16:03:47,262 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3fbd1828b59558a2ffca1be9af02f6e2: 2023-02-13 16:03:47,263 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:47,263 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 16:03:47,268 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/.tmp/f1/4f3ad2ff707f4a92bffec5679230bad9 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f1/4f3ad2ff707f4a92bffec5679230bad9 2023-02-13 16:03:47,273 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f1/4f3ad2ff707f4a92bffec5679230bad9, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,274 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/.tmp/f2/12e77f4ca14a4cf2977d5773410ef5a2 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f2/12e77f4ca14a4cf2977d5773410ef5a2 2023-02-13 16:03:47,279 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f2/12e77f4ca14a4cf2977d5773410ef5a2, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:47,280 INFO [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 0b2a1bd67c080415da09adb5d6485652 in 112ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:47,281 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 0b2a1bd67c080415da09adb5d6485652: 2023-02-13 16:03:47,281 DEBUG [rs(jenkins-hbase4.apache.org,35057,1676304222167)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:47,281 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 16:03:47,281 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 16:03:47,281 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,281 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 16:03:47,281 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35057,1676304222167' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 16:03:47,283 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,283 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:47,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:47,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:47,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35057,1676304222167' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 16:03:47,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@572d8fd9[Count = 0] remaining members to acquire global barrier 2023-02-13 16:03:47,286 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 16:03:47,286 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,287 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,287 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,287 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 16:03:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 16:03:47,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,35057,1676304222167' in zk 2023-02-13 16:03:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 16:03:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 16:03:47,287 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,39793,1676304222126' in zk 2023-02-13 16:03:47,288 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,288 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:03:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 16:03:47,289 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,289 DEBUG [member: 'jenkins-hbase4.apache.org,35057,1676304222167' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 16:03:47,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:47,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:47,290 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 16:03:47,290 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,290 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:47,290 DEBUG [member: 'jenkins-hbase4.apache.org,39793,1676304222126' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 16:03:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,35057,1676304222167': 2023-02-13 16:03:47,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35057,1676304222167' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 1 more 2023-02-13 16:03:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:47,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:47,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:47,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,39793,1676304222126': 2023-02-13 16:03:47,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39793,1676304222126' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 16:03:47,297 INFO [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 16:03:47,297 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:03:47,297 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:03:47,298 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 16:03:47,298 INFO [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 16:03:47,300 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,300 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:47,300 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,301 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:47,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,301 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:47,301 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,302 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:47,305 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:03:47,305 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,308 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,308 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:47,308 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,308 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:03:47,308 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,308 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:47,308 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,308 DEBUG [(jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:47,308 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 16:03:47,309 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:03:47,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:47,308 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:47,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:47,310 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:03:47,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 16:03:47,308 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:47,310 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:47,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:47,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:47,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:47,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:47,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:47,310 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 16:03:47,311 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 16:03:47,411 DEBUG [Listener at localhost/44363] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 16:03:47,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40869] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 16:03:47,413 INFO [Listener at localhost/44363] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 16:03:47,413 DEBUG [Listener at localhost/44363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x241b9dd6 to 127.0.0.1:57466 2023-02-13 16:03:47,413 DEBUG [Listener at localhost/44363] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:47,413 DEBUG [Listener at localhost/44363] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 16:03:47,414 DEBUG [Listener at localhost/44363] util.JVMClusterUtil(257): Found active master hash=672228511, stopped=false 2023-02-13 16:03:47,414 INFO [Listener at localhost/44363] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40869,1676304222059 2023-02-13 16:03:47,415 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:47,415 INFO [Listener at localhost/44363] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 16:03:47,415 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:47,415 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:47,415 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:47,416 DEBUG [Listener at localhost/44363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5823e739 to 127.0.0.1:57466 2023-02-13 16:03:47,417 DEBUG [Listener at localhost/44363] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:47,417 INFO [Listener at localhost/44363] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39793,1676304222126' ***** 2023-02-13 16:03:47,417 INFO [Listener at localhost/44363] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:03:47,417 INFO [Listener at localhost/44363] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35057,1676304222167' ***** 2023-02-13 16:03:47,417 INFO [Listener at localhost/44363] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:03:47,418 INFO [RS:1;jenkins-hbase4:35057] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:03:47,418 INFO [RS:1;jenkins-hbase4:35057] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:03:47,418 INFO [RS:1;jenkins-hbase4:35057] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:03:47,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:47,418 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:03:47,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:47,418 INFO [RS:0;jenkins-hbase4:39793] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:03:47,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:47,419 INFO [RS:0;jenkins-hbase4:39793] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:03:47,419 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:03:47,419 INFO [RS:0;jenkins-hbase4:39793] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:03:47,418 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(3304): Received CLOSE for 4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:47,420 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(3304): Received CLOSE for b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:47,420 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(3304): Received CLOSE for ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:47,421 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(3304): Received CLOSE for 5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:47,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4a20bf98bd5b018f1a28063cb96011e2, disabling compactions & flushes 2023-02-13 16:03:47,421 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(3304): Received CLOSE for bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:47,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:47,421 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(3304): Received CLOSE for 397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:47,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:47,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b540b745c9d2f8a61806ca62f0ac6f9e, disabling compactions & flushes 2023-02-13 16:03:47,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. after waiting 0 ms 2023-02-13 16:03:47,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:47,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:47,421 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(3304): Received CLOSE for 121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:47,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:47,421 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(3304): Received CLOSE for 5091a65bef236c48f1fb739e6d84bea1 2023-02-13 16:03:47,421 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(3304): Received CLOSE for 3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:47,421 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(3304): Received CLOSE for 0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:47,421 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,421 DEBUG [RS:1;jenkins-hbase4:35057] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4279d68a to 127.0.0.1:57466 2023-02-13 16:03:47,421 DEBUG [RS:1;jenkins-hbase4:35057] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:47,421 INFO [RS:1;jenkins-hbase4:35057] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:03:47,421 INFO [RS:1;jenkins-hbase4:35057] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:03:47,421 INFO [RS:1;jenkins-hbase4:35057] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:03:47,421 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 16:03:47,421 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(3304): Received CLOSE for d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:47,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. after waiting 0 ms 2023-02-13 16:03:47,422 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:47,422 DEBUG [RS:0;jenkins-hbase4:39793] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45eb441e to 127.0.0.1:57466 2023-02-13 16:03:47,422 DEBUG [RS:0;jenkins-hbase4:39793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:47,422 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1475): Waiting on 5 regions to close 2023-02-13 16:03:47,422 DEBUG [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1479): Online Regions={b540b745c9d2f8a61806ca62f0ac6f9e=testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e., 5cc0251f2a699eafc3b80793e4405fde=testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde., bee40e2fed40d46b5f11b2d0c6c6c9fa=testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa., 397270e8716ff8c1be713a2aac73d948=testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948., d49e5e9dc9c8c646aa9e4a6b3553ba1f=testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.} 2023-02-13 16:03:47,422 DEBUG [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1505): Waiting on 397270e8716ff8c1be713a2aac73d948, 5cc0251f2a699eafc3b80793e4405fde, b540b745c9d2f8a61806ca62f0ac6f9e, bee40e2fed40d46b5f11b2d0c6c6c9fa, d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:47,423 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1475): Waiting on 7 regions to close 2023-02-13 16:03:47,424 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:03:47,424 DEBUG [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1479): Online Regions={4a20bf98bd5b018f1a28063cb96011e2=testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2., ba17dfff6d375413082eb96ecdbfe764=testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764., 121d5e32312bbfb25df57897b25d68c2=testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2., 5091a65bef236c48f1fb739e6d84bea1=hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1., 1588230740=hbase:meta,,1.1588230740, 3fbd1828b59558a2ffca1be9af02f6e2=testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2., 0b2a1bd67c080415da09adb5d6485652=testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.} 2023-02-13 16:03:47,425 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:03:47,427 DEBUG [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1505): Waiting on 0b2a1bd67c080415da09adb5d6485652, 121d5e32312bbfb25df57897b25d68c2, 1588230740, 3fbd1828b59558a2ffca1be9af02f6e2, 4a20bf98bd5b018f1a28063cb96011e2, 5091a65bef236c48f1fb739e6d84bea1, ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:47,427 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:03:47,427 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:03:47,427 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:03:47,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=13.95 KB heapSize=23.05 KB 2023-02-13 16:03:47,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:47,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:47,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:47,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4a20bf98bd5b018f1a28063cb96011e2: Waiting for close lock at 1676304227421Running coprocessor pre-close hooks at 1676304227421Disabling compacts and flushes for region at 1676304227421Disabling writes for close at 1676304227421Writing region close event to WAL at 1676304227431 (+10 ms)Running coprocessor post-close hooks at 1676304227436 (+5 ms)Closed at 1676304227437 (+1 ms) 2023-02-13 16:03:47,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:47,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ba17dfff6d375413082eb96ecdbfe764, disabling compactions & flushes 2023-02-13 16:03:47,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:47,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:47,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. after waiting 0 ms 2023-02-13 16:03:47,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:47,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:47,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b540b745c9d2f8a61806ca62f0ac6f9e: Waiting for close lock at 1676304227421Running coprocessor pre-close hooks at 1676304227421Disabling compacts and flushes for region at 1676304227421Disabling writes for close at 1676304227422 (+1 ms)Writing region close event to WAL at 1676304227432 (+10 ms)Running coprocessor post-close hooks at 1676304227438 (+6 ms)Closed at 1676304227439 (+1 ms) 2023-02-13 16:03:47,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:47,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5cc0251f2a699eafc3b80793e4405fde, disabling compactions & flushes 2023-02-13 16:03:47,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:47,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:47,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. after waiting 0 ms 2023-02-13 16:03:47,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:47,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:47,457 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=13.76 KB at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/.tmp/info/11b0af53426f4fee93965073b57d42a9 2023-02-13 16:03:47,457 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:47,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:47,458 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ba17dfff6d375413082eb96ecdbfe764: Waiting for close lock at 1676304227438Running coprocessor pre-close hooks at 1676304227438Disabling compacts and flushes for region at 1676304227438Disabling writes for close at 1676304227438Writing region close event to WAL at 1676304227447 (+9 ms)Running coprocessor post-close hooks at 1676304227458 (+11 ms)Closed at 1676304227458 2023-02-13 16:03:47,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:47,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:47,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5cc0251f2a699eafc3b80793e4405fde: Waiting for close lock at 1676304227439Running coprocessor pre-close hooks at 1676304227439Disabling compacts and flushes for region at 1676304227439Disabling writes for close at 1676304227441 (+2 ms)Writing region close event to WAL at 1676304227454 (+13 ms)Running coprocessor post-close hooks at 1676304227458 (+4 ms)Closed at 1676304227459 (+1 ms) 2023-02-13 16:03:47,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 121d5e32312bbfb25df57897b25d68c2, disabling compactions & flushes 2023-02-13 16:03:47,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:47,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:47,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:47,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing bee40e2fed40d46b5f11b2d0c6c6c9fa, disabling compactions & flushes 2023-02-13 16:03:47,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. after waiting 0 ms 2023-02-13 16:03:47,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:47,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:47,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:47,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. after waiting 0 ms 2023-02-13 16:03:47,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:47,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 16:03:47,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:47,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for bee40e2fed40d46b5f11b2d0c6c6c9fa: Waiting for close lock at 1676304227459Running coprocessor pre-close hooks at 1676304227459Disabling compacts and flushes for region at 1676304227459Disabling writes for close at 1676304227460 (+1 ms)Writing region close event to WAL at 1676304227460Running coprocessor post-close hooks at 1676304227464 (+4 ms)Closed at 1676304227465 (+1 ms) 2023-02-13 16:03:47,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:47,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:47,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 397270e8716ff8c1be713a2aac73d948, disabling compactions & flushes 2023-02-13 16:03:47,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:47,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:47,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. after waiting 0 ms 2023-02-13 16:03:47,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:47,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:47,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 121d5e32312bbfb25df57897b25d68c2: Waiting for close lock at 1676304227459Running coprocessor pre-close hooks at 1676304227459Disabling compacts and flushes for region at 1676304227459Disabling writes for close at 1676304227460 (+1 ms)Writing region close event to WAL at 1676304227461 (+1 ms)Running coprocessor post-close hooks at 1676304227465 (+4 ms)Closed at 1676304227466 (+1 ms) 2023-02-13 16:03:47,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:47,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5091a65bef236c48f1fb739e6d84bea1, disabling compactions & flushes 2023-02-13 16:03:47,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:47,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:47,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. after waiting 0 ms 2023-02-13 16:03:47,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:47,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 5091a65bef236c48f1fb739e6d84bea1 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 16:03:47,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:47,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:47,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 397270e8716ff8c1be713a2aac73d948: Waiting for close lock at 1676304227465Running coprocessor pre-close hooks at 1676304227465Disabling compacts and flushes for region at 1676304227465Disabling writes for close at 1676304227465Writing region close event to WAL at 1676304227467 (+2 ms)Running coprocessor post-close hooks at 1676304227472 (+5 ms)Closed at 1676304227475 (+3 ms) 2023-02-13 16:03:47,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:47,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d49e5e9dc9c8c646aa9e4a6b3553ba1f, disabling compactions & flushes 2023-02-13 16:03:47,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:47,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:47,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. after waiting 0 ms 2023-02-13 16:03:47,476 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:47,480 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=192 B at sequenceid=32 (bloomFilter=false), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/.tmp/table/297cad2ee15f45808126b148f0fdd8b9 2023-02-13 16:03:47,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 16:03:47,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:47,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d49e5e9dc9c8c646aa9e4a6b3553ba1f: Waiting for close lock at 1676304227475Running coprocessor pre-close hooks at 1676304227475Disabling compacts and flushes for region at 1676304227475Disabling writes for close at 1676304227476 (+1 ms)Writing region close event to WAL at 1676304227476Running coprocessor post-close hooks at 1676304227481 (+5 ms)Closed at 1676304227483 (+2 ms) 2023-02-13 16:03:47,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:47,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1/.tmp/info/70e0c81747214aacb5296845929aa38a 2023-02-13 16:03:47,489 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/.tmp/info/11b0af53426f4fee93965073b57d42a9 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/info/11b0af53426f4fee93965073b57d42a9 2023-02-13 16:03:47,490 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:47,490 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:47,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1/.tmp/info/70e0c81747214aacb5296845929aa38a as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1/info/70e0c81747214aacb5296845929aa38a 2023-02-13 16:03:47,495 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/info/11b0af53426f4fee93965073b57d42a9, entries=110, sequenceid=32, filesize=18.7 K 2023-02-13 16:03:47,496 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/.tmp/table/297cad2ee15f45808126b148f0fdd8b9 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/table/297cad2ee15f45808126b148f0fdd8b9 2023-02-13 16:03:47,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1/info/70e0c81747214aacb5296845929aa38a, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 16:03:47,501 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/table/297cad2ee15f45808126b148f0fdd8b9, entries=4, sequenceid=32, filesize=4.8 K 2023-02-13 16:03:47,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5091a65bef236c48f1fb739e6d84bea1 in 37ms, sequenceid=6, compaction requested=false 2023-02-13 16:03:47,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-13 16:03:47,505 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=32, compaction requested=false 2023-02-13 16:03:47,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-13 16:03:47,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/namespace/5091a65bef236c48f1fb739e6d84bea1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 16:03:47,509 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/hbase/meta/1588230740/recovered.edits/35.seqid, newMaxSeqId=35, maxSeqId=1 2023-02-13 16:03:47,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:47,509 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 16:03:47,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5091a65bef236c48f1fb739e6d84bea1: Waiting for close lock at 1676304227466Running coprocessor pre-close hooks at 1676304227466Disabling compacts and flushes for region at 1676304227466Disabling writes for close at 1676304227467 (+1 ms)Obtaining lock to block concurrent updates at 1676304227467Preparing flush snapshotting stores in 5091a65bef236c48f1fb739e6d84bea1 at 1676304227467Finished memstore snapshotting hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676304227467Flushing stores of hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. at 1676304227467Flushing 5091a65bef236c48f1fb739e6d84bea1/info: creating writer at 1676304227467Flushing 5091a65bef236c48f1fb739e6d84bea1/info: appending metadata at 1676304227470 (+3 ms)Flushing 5091a65bef236c48f1fb739e6d84bea1/info: closing flushed file at 1676304227470Flushing 5091a65bef236c48f1fb739e6d84bea1/info: reopening flushed file at 1676304227495 (+25 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 5091a65bef236c48f1fb739e6d84bea1 in 37ms, sequenceid=6, compaction requested=false at 1676304227504 (+9 ms)Writing region close event to WAL at 1676304227506 (+2 ms)Running coprocessor post-close hooks at 1676304227509 (+3 ms)Closed at 1676304227509 2023-02-13 16:03:47,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:03:47,509 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304227424Running coprocessor pre-close hooks at 1676304227424Disabling compacts and flushes for region at 1676304227424Disabling writes for close at 1676304227427 (+3 ms)Obtaining lock to block concurrent updates at 1676304227431 (+4 ms)Preparing flush snapshotting stores in 1588230740 at 1676304227431Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=14280, getHeapSize=23552, getOffHeapSize=0, getCellsCount=114 at 1676304227432 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676304227432Flushing 1588230740/info: creating writer at 1676304227433 (+1 ms)Flushing 1588230740/info: appending metadata at 1676304227436 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676304227436Flushing 1588230740/table: creating writer at 1676304227465 (+29 ms)Flushing 1588230740/table: appending metadata at 1676304227468 (+3 ms)Flushing 1588230740/table: closing flushed file at 1676304227468Flushing 1588230740/info: reopening flushed file at 1676304227489 (+21 ms)Flushing 1588230740/table: reopening flushed file at 1676304227496 (+7 ms)Finished flush of dataSize ~13.95 KB/14280, heapSize ~22.77 KB/23312, currentSize=0 B/0 for 1588230740 in 76ms, sequenceid=32, compaction requested=false at 1676304227505 (+9 ms)Writing region close event to WAL at 1676304227506 (+1 ms)Running coprocessor post-close hooks at 1676304227509 (+3 ms)Closed at 1676304227509 2023-02-13 16:03:47,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676304222941.5091a65bef236c48f1fb739e6d84bea1. 2023-02-13 16:03:47,510 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 16:03:47,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3fbd1828b59558a2ffca1be9af02f6e2, disabling compactions & flushes 2023-02-13 16:03:47,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:47,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:47,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. after waiting 0 ms 2023-02-13 16:03:47,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:47,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:47,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:47,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3fbd1828b59558a2ffca1be9af02f6e2: Waiting for close lock at 1676304227510Running coprocessor pre-close hooks at 1676304227510Disabling compacts and flushes for region at 1676304227510Disabling writes for close at 1676304227510Writing region close event to WAL at 1676304227511 (+1 ms)Running coprocessor post-close hooks at 1676304227514 (+3 ms)Closed at 1676304227514 2023-02-13 16:03:47,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:47,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 0b2a1bd67c080415da09adb5d6485652, disabling compactions & flushes 2023-02-13 16:03:47,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:47,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:47,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. after waiting 0 ms 2023-02-13 16:03:47,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:47,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:47,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:47,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 0b2a1bd67c080415da09adb5d6485652: Waiting for close lock at 1676304227514Running coprocessor pre-close hooks at 1676304227514Disabling compacts and flushes for region at 1676304227514Disabling writes for close at 1676304227514Writing region close event to WAL at 1676304227516 (+2 ms)Running coprocessor post-close hooks at 1676304227519 (+3 ms)Closed at 1676304227519 2023-02-13 16:03:47,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:47,622 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39793,1676304222126; all regions closed. 2023-02-13 16:03:47,627 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35057,1676304222167; all regions closed. 2023-02-13 16:03:47,629 DEBUG [RS:0;jenkins-hbase4:39793] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/oldWALs 2023-02-13 16:03:47,629 INFO [RS:0;jenkins-hbase4:39793] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39793%2C1676304222126:(num 1676304223822) 2023-02-13 16:03:47,629 DEBUG [RS:0;jenkins-hbase4:39793] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:47,629 INFO [RS:0;jenkins-hbase4:39793] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:47,629 INFO [RS:0;jenkins-hbase4:39793] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 16:03:47,629 INFO [RS:0;jenkins-hbase4:39793] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:03:47,629 INFO [RS:0;jenkins-hbase4:39793] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:03:47,629 INFO [RS:0;jenkins-hbase4:39793] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:03:47,630 INFO [RS:0;jenkins-hbase4:39793] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39793 2023-02-13 16:03:47,630 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:03:47,634 DEBUG [RS:1;jenkins-hbase4:35057] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/oldWALs 2023-02-13 16:03:47,634 INFO [RS:1;jenkins-hbase4:35057] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35057%2C1676304222167.meta:.meta(num 1676304222857) 2023-02-13 16:03:47,640 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,641 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39793,1676304222126 2023-02-13 16:03:47,641 ERROR [Listener at localhost/44363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@58385dd3 rejected from java.util.concurrent.ThreadPoolExecutor@5c07d20c[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:47,641 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:47,641 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:47,641 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:47,641 ERROR [Listener at localhost/44363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@321a39ed rejected from java.util.concurrent.ThreadPoolExecutor@5c07d20c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:47,642 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39793,1676304222126] 2023-02-13 16:03:47,642 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39793,1676304222126; numProcessing=1 2023-02-13 16:03:47,644 DEBUG [RS:1;jenkins-hbase4:35057] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/oldWALs 2023-02-13 16:03:47,644 INFO [RS:1;jenkins-hbase4:35057] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35057%2C1676304222167:(num 1676304223338) 2023-02-13 16:03:47,644 DEBUG [RS:1;jenkins-hbase4:35057] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:47,644 INFO [RS:1;jenkins-hbase4:35057] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:47,644 INFO [RS:1;jenkins-hbase4:35057] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 16:03:47,645 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:03:47,645 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39793,1676304222126 already deleted, retry=false 2023-02-13 16:03:47,645 INFO [RS:1;jenkins-hbase4:35057] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35057 2023-02-13 16:03:47,645 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39793,1676304222126 expired; onlineServers=1 2023-02-13 16:03:47,648 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:47,648 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35057,1676304222167 2023-02-13 16:03:47,648 ERROR [Listener at localhost/44363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4dc5a507 rejected from java.util.concurrent.ThreadPoolExecutor@49fa3867[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:47,649 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35057,1676304222167] 2023-02-13 16:03:47,649 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35057,1676304222167; numProcessing=2 2023-02-13 16:03:47,650 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35057,1676304222167 already deleted, retry=false 2023-02-13 16:03:47,650 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35057,1676304222167 expired; onlineServers=0 2023-02-13 16:03:47,650 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,40869,1676304222059' ***** 2023-02-13 16:03:47,650 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 16:03:47,651 DEBUG [M:0;jenkins-hbase4:40869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@692c6ea4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:47,651 INFO [M:0;jenkins-hbase4:40869] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,40869,1676304222059 2023-02-13 16:03:47,651 INFO [M:0;jenkins-hbase4:40869] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,40869,1676304222059; all regions closed. 2023-02-13 16:03:47,651 DEBUG [M:0;jenkins-hbase4:40869] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:47,651 DEBUG [M:0;jenkins-hbase4:40869] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 16:03:47,651 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 16:03:47,651 DEBUG [M:0;jenkins-hbase4:40869] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 16:03:47,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304222433] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304222433,5,FailOnTimeoutGroup] 2023-02-13 16:03:47,652 INFO [M:0;jenkins-hbase4:40869] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 16:03:47,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304222435] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304222435,5,FailOnTimeoutGroup] 2023-02-13 16:03:47,653 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:47,653 INFO [M:0;jenkins-hbase4:40869] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 16:03:47,653 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:47,653 INFO [M:0;jenkins-hbase4:40869] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 16:03:47,654 DEBUG [M:0;jenkins-hbase4:40869] master.HMaster(1502): Stopping service threads 2023-02-13 16:03:47,654 INFO [M:0;jenkins-hbase4:40869] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 16:03:47,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:47,654 ERROR [M:0;jenkins-hbase4:40869] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 16:03:47,654 INFO [M:0;jenkins-hbase4:40869] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 16:03:47,654 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 16:03:47,655 DEBUG [M:0;jenkins-hbase4:40869] zookeeper.ZKUtil(398): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 16:03:47,655 WARN [M:0;jenkins-hbase4:40869] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 16:03:47,655 INFO [M:0;jenkins-hbase4:40869] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 16:03:47,655 INFO [M:0;jenkins-hbase4:40869] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 16:03:47,655 DEBUG [M:0;jenkins-hbase4:40869] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:03:47,655 INFO [M:0;jenkins-hbase4:40869] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:47,655 DEBUG [M:0;jenkins-hbase4:40869] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:47,655 DEBUG [M:0;jenkins-hbase4:40869] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:03:47,655 DEBUG [M:0;jenkins-hbase4:40869] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:47,656 INFO [M:0;jenkins-hbase4:40869] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=100.94 KB heapSize=120.63 KB 2023-02-13 16:03:47,665 INFO [M:0;jenkins-hbase4:40869] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=100.94 KB at sequenceid=218 (bloomFilter=true), to=hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/02cb4765b090480d928b7e86c8469166 2023-02-13 16:03:47,670 DEBUG [M:0;jenkins-hbase4:40869] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/02cb4765b090480d928b7e86c8469166 as hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/02cb4765b090480d928b7e86c8469166 2023-02-13 16:03:47,674 INFO [M:0;jenkins-hbase4:40869] regionserver.HStore(1080): Added hdfs://localhost:35349/user/jenkins/test-data/7e6dc9c5-3484-3ff7-93c6-fb0e228549f7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/02cb4765b090480d928b7e86c8469166, entries=31, sequenceid=218, filesize=9.0 K 2023-02-13 16:03:47,675 INFO [M:0;jenkins-hbase4:40869] regionserver.HRegion(2947): Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false 2023-02-13 16:03:47,676 INFO [M:0;jenkins-hbase4:40869] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:47,676 DEBUG [M:0;jenkins-hbase4:40869] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304227655Disabling compacts and flushes for region at 1676304227655Disabling writes for close at 1676304227655Obtaining lock to block concurrent updates at 1676304227656 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676304227656Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=103362, getHeapSize=123512, getOffHeapSize=0, getCellsCount=263 at 1676304227656Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676304227657 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676304227657Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676304227659 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676304227659Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676304227670 (+11 ms)Finished flush of dataSize ~100.94 KB/103362, heapSize ~120.62 KB/123512, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 20ms, sequenceid=218, compaction requested=false at 1676304227675 (+5 ms)Writing region close event to WAL at 1676304227676 (+1 ms)Closed at 1676304227676 2023-02-13 16:03:47,679 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:03:47,679 INFO [M:0;jenkins-hbase4:40869] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 16:03:47,680 INFO [M:0;jenkins-hbase4:40869] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40869 2023-02-13 16:03:47,684 DEBUG [M:0;jenkins-hbase4:40869] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40869,1676304222059 already deleted, retry=false 2023-02-13 16:03:47,824 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:47,824 INFO [M:0;jenkins-hbase4:40869] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,40869,1676304222059; zookeeper connection closed. 2023-02-13 16:03:47,824 ERROR [Listener at localhost/44363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b1875e6 rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:47,825 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): master:40869-0x1004e6c71100000, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:47,825 ERROR [Listener at localhost/44363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@335a1355 rejected from java.util.concurrent.ThreadPoolExecutor@1f27e25d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 56] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:47,924 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:47,924 INFO [RS:1;jenkins-hbase4:35057] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35057,1676304222167; zookeeper connection closed. 2023-02-13 16:03:47,924 ERROR [Listener at localhost/44363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5d33cf5f rejected from java.util.concurrent.ThreadPoolExecutor@49fa3867[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:47,924 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:35057-0x1004e6c71100002, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:47,924 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@10153455] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@10153455 2023-02-13 16:03:47,924 ERROR [Listener at localhost/44363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@251f9aa3 rejected from java.util.concurrent.ThreadPoolExecutor@49fa3867[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 19] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:48,024 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:48,024 INFO [RS:0;jenkins-hbase4:39793] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39793,1676304222126; zookeeper connection closed. 2023-02-13 16:03:48,024 ERROR [Listener at localhost/44363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4aa31c0c rejected from java.util.concurrent.ThreadPoolExecutor@5c07d20c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:48,024 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1d627eab] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1d627eab 2023-02-13 16:03:48,024 DEBUG [Listener at localhost/44363-EventThread] zookeeper.ZKWatcher(600): regionserver:39793-0x1004e6c71100001, quorum=127.0.0.1:57466, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:48,025 ERROR [Listener at localhost/44363-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a1c333e rejected from java.util.concurrent.ThreadPoolExecutor@5c07d20c[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:48,025 INFO [Listener at localhost/44363] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 16:03:48,111 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/hadoop-1236173130895955498.jar 2023-02-13 16:03:48,116 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676304224430 type: FLUSH version: 2 ttl: 0 2023-02-13 16:03:48,116 DEBUG [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce 2023-02-13 16:03:48,117 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(239): region to add: 4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:48,117 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(239): region to add: ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:48,117 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(239): region to add: 121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:48,117 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(239): region to add: b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:48,117 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(239): region to add: 5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:48,117 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(239): region to add: bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:48,117 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(239): region to add: 397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:48,117 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(239): region to add: 3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:48,117 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(239): region to add: d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:48,117 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(239): region to add: 0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:48,118 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(585): clone region=4a20bf98bd5b018f1a28063cb96011e2 as 4a20bf98bd5b018f1a28063cb96011e2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:48,118 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(585): clone region=ba17dfff6d375413082eb96ecdbfe764 as ba17dfff6d375413082eb96ecdbfe764 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:48,118 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(585): clone region=121d5e32312bbfb25df57897b25d68c2 as 121d5e32312bbfb25df57897b25d68c2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:48,118 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(585): clone region=b540b745c9d2f8a61806ca62f0ac6f9e as b540b745c9d2f8a61806ca62f0ac6f9e in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:48,118 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(585): clone region=5cc0251f2a699eafc3b80793e4405fde as 5cc0251f2a699eafc3b80793e4405fde in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:48,118 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(585): clone region=bee40e2fed40d46b5f11b2d0c6c6c9fa as bee40e2fed40d46b5f11b2d0c6c6c9fa in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:48,118 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(585): clone region=397270e8716ff8c1be713a2aac73d948 as 397270e8716ff8c1be713a2aac73d948 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:48,118 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(585): clone region=3fbd1828b59558a2ffca1be9af02f6e2 as 3fbd1828b59558a2ffca1be9af02f6e2 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:48,118 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(585): clone region=d49e5e9dc9c8c646aa9e4a6b3553ba1f as d49e5e9dc9c8c646aa9e4a6b3553ba1f in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:48,118 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(585): clone region=0b2a1bd67c080415da09adb5d6485652 as 0b2a1bd67c080415da09adb5d6485652 in snapshot testWithMapReduceAndOfflineHBaseMultiRegion 2023-02-13 16:03:48,119 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4a20bf98bd5b018f1a28063cb96011e2, NAME => 'testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,119 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => ba17dfff6d375413082eb96ecdbfe764, NAME => 'testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,120 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 5cc0251f2a699eafc3b80793e4405fde, NAME => 'testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,121 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 121d5e32312bbfb25df57897b25d68c2, NAME => 'testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,121 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 3fbd1828b59558a2ffca1be9af02f6e2, NAME => 'testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,121 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => b540b745c9d2f8a61806ca62f0ac6f9e, NAME => 'testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,121 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => 397270e8716ff8c1be713a2aac73d948, NAME => 'testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,122 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => bee40e2fed40d46b5f11b2d0c6c6c9fa, NAME => 'testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,135 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:48,136 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 41925e0f97654f9d9d8b9d9b862279f9 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,137 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:48,137 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:48,137 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 11ff2bf9d6bf452caad8eb2ee8bd6f7a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,137 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 39849fadaa6a4023889a62bee66e49da from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,140 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:48,140 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 430864c194ea4909b68721aea9c08483 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,143 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:48,143 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9c59ff31cd50444cb129a76851bded54 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,143 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 3454f9659a12497ca7b7b4b5b5c860ca from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,143 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 18f61dd517a14855a2f76d3e837b8181 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,144 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:48,144 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink ef7991cb7b7b4fceab26c8b03c9661f5 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,148 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a73391bf12eb4d6592c233775c347dd0 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,148 INFO [RestoreSnapshot-pool-6] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 70e2f4b0528f480e9c7a97c961cbff3d from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,149 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a15631749e8f420fb8cd89ccb561ec1f from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,149 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 121d5e32312bbfb25df57897b25d68c2, disabling compactions & flushes 2023-02-13 16:03:48,149 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:48,149 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:48,149 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. after waiting 0 ms 2023-02-13 16:03:48,149 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:48,149 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:48,149 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 121d5e32312bbfb25df57897b25d68c2: Waiting for close lock at 1676304228149Disabling compacts and flushes for region at 1676304228149Disabling writes for close at 1676304228149Writing region close event to WAL at 1676304228149Closed at 1676304228149 2023-02-13 16:03:48,150 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => d49e5e9dc9c8c646aa9e4a6b3553ba1f, NAME => 'testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,162 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 53e5dac9ab624a149a296e032c3e6b25 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,162 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 4a20bf98bd5b018f1a28063cb96011e2, disabling compactions & flushes 2023-02-13 16:03:48,162 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:48,162 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:48,162 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:48,162 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 3fbd1828b59558a2ffca1be9af02f6e2, disabling compactions & flushes 2023-02-13 16:03:48,162 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink db2c1c939e804f42bf8f5562ba36f6eb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,162 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. after waiting 0 ms 2023-02-13 16:03:48,163 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing 397270e8716ff8c1be713a2aac73d948, disabling compactions & flushes 2023-02-13 16:03:48,163 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:48,163 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:48,163 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. after waiting 0 ms 2023-02-13 16:03:48,163 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:48,163 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:48,163 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:48,163 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 3fbd1828b59558a2ffca1be9af02f6e2: Waiting for close lock at 1676304228162Disabling compacts and flushes for region at 1676304228162Disabling writes for close at 1676304228163 (+1 ms)Writing region close event to WAL at 1676304228163Closed at 1676304228163 2023-02-13 16:03:48,163 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:48,163 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing bee40e2fed40d46b5f11b2d0c6c6c9fa, disabling compactions & flushes 2023-02-13 16:03:48,163 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:48,163 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:48,164 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing ba17dfff6d375413082eb96ecdbfe764, disabling compactions & flushes 2023-02-13 16:03:48,164 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 4a20bf98bd5b018f1a28063cb96011e2: Waiting for close lock at 1676304228162Disabling compacts and flushes for region at 1676304228162Disabling writes for close at 1676304228163 (+1 ms)Writing region close event to WAL at 1676304228163Closed at 1676304228163 2023-02-13 16:03:48,164 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:48,164 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => 0b2a1bd67c080415da09adb5d6485652, NAME => 'testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMapReduce', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,164 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:48,164 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:48,164 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. after waiting 0 ms 2023-02-13 16:03:48,164 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:48,164 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:48,164 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:48,164 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. after waiting 0 ms 2023-02-13 16:03:48,164 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:48,164 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. after waiting 0 ms 2023-02-13 16:03:48,165 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for ba17dfff6d375413082eb96ecdbfe764: Waiting for close lock at 1676304228163Disabling compacts and flushes for region at 1676304228163Disabling writes for close at 1676304228164 (+1 ms)Writing region close event to WAL at 1676304228164Closed at 1676304228164 2023-02-13 16:03:48,164 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:48,165 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:48,165 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for 397270e8716ff8c1be713a2aac73d948: Waiting for close lock at 1676304228163Disabling compacts and flushes for region at 1676304228163Disabling writes for close at 1676304228164 (+1 ms)Writing region close event to WAL at 1676304228165 (+1 ms)Closed at 1676304228165 2023-02-13 16:03:48,165 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:48,165 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:48,165 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for bee40e2fed40d46b5f11b2d0c6c6c9fa: Waiting for close lock at 1676304228163Disabling compacts and flushes for region at 1676304228163Disabling writes for close at 1676304228165 (+2 ms)Writing region close event to WAL at 1676304228165Closed at 1676304228165 2023-02-13 16:03:48,172 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 950a3f54a47f47998e7449d5d5cffea8 from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,172 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing b540b745c9d2f8a61806ca62f0ac6f9e, disabling compactions & flushes 2023-02-13 16:03:48,172 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:48,172 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:48,172 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. after waiting 0 ms 2023-02-13 16:03:48,172 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:48,172 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:48,172 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for b540b745c9d2f8a61806ca62f0ac6f9e: Waiting for close lock at 1676304228172Disabling compacts and flushes for region at 1676304228172Disabling writes for close at 1676304228172Writing region close event to WAL at 1676304228172Closed at 1676304228172 2023-02-13 16:03:48,174 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:48,174 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing d49e5e9dc9c8c646aa9e4a6b3553ba1f, disabling compactions & flushes 2023-02-13 16:03:48,174 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:48,174 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:48,174 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. after waiting 0 ms 2023-02-13 16:03:48,174 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:48,174 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:48,174 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for d49e5e9dc9c8c646aa9e4a6b3553ba1f: Waiting for close lock at 1676304228174Disabling compacts and flushes for region at 1676304228174Disabling writes for close at 1676304228174Writing region close event to WAL at 1676304228174Closed at 1676304228174 2023-02-13 16:03:48,176 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 5cc0251f2a699eafc3b80793e4405fde, disabling compactions & flushes 2023-02-13 16:03:48,176 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:48,176 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:48,176 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. after waiting 0 ms 2023-02-13 16:03:48,176 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:48,176 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:48,176 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 5cc0251f2a699eafc3b80793e4405fde: Waiting for close lock at 1676304228176Disabling compacts and flushes for region at 1676304228176Disabling writes for close at 1676304228176Writing region close event to WAL at 1676304228176Closed at 1676304228176 2023-02-13 16:03:48,178 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:48,178 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink dcbd1ab9005d4382a0e9146db8db9b7a from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,180 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e9e9d806cf8f4b9792ac5158bdfd3dbb from cloned region in snapshot testWithMapReduceAndOfflineHBaseMultiRegion to table=testWithMapReduce 2023-02-13 16:03:48,182 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing 0b2a1bd67c080415da09adb5d6485652, disabling compactions & flushes 2023-02-13 16:03:48,182 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:48,182 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:48,182 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. after waiting 0 ms 2023-02-13 16:03:48,182 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:48,182 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:48,182 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for 0b2a1bd67c080415da09adb5d6485652: Waiting for close lock at 1676304228182Disabling compacts and flushes for region at 1676304228182Disabling writes for close at 1676304228182Writing region close event to WAL at 1676304228182Closed at 1676304228182 2023-02-13 16:03:48,183 INFO [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceAndOfflineHBaseMultiRegion" table: "testWithMapReduce" creation_time: 1676304224430 type: FLUSH version: 2 ttl: 0 2023-02-13 16:03:48,183 DEBUG [Listener at localhost/44363] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,183 DEBUG [Listener at localhost/44363] util.CommonFSUtils(682): File system contents for path hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82 2023-02-13 16:03:48,184 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-data/ 2023-02-13 16:03:48,184 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----default/ 2023-02-13 16:03:48,185 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 16:03:48,186 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----------0b2a1bd67c080415da09adb5d6485652/ 2023-02-13 16:03:48,186 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:48,186 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:48,187 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=0b2a1bd67c080415da09adb5d6485652-dcbd1ab9005d4382a0e9146db8db9b7a 2023-02-13 16:03:48,187 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:48,188 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=0b2a1bd67c080415da09adb5d6485652-e9e9d806cf8f4b9792ac5158bdfd3dbb 2023-02-13 16:03:48,188 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----------121d5e32312bbfb25df57897b25d68c2/ 2023-02-13 16:03:48,188 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:48,188 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:48,189 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=121d5e32312bbfb25df57897b25d68c2-39849fadaa6a4023889a62bee66e49da 2023-02-13 16:03:48,189 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:48,189 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=121d5e32312bbfb25df57897b25d68c2-18f61dd517a14855a2f76d3e837b8181 2023-02-13 16:03:48,190 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----------397270e8716ff8c1be713a2aac73d948/ 2023-02-13 16:03:48,190 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:48,190 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:48,191 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=397270e8716ff8c1be713a2aac73d948-9c59ff31cd50444cb129a76851bded54 2023-02-13 16:03:48,191 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:48,191 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=397270e8716ff8c1be713a2aac73d948-70e2f4b0528f480e9c7a97c961cbff3d 2023-02-13 16:03:48,191 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----------3fbd1828b59558a2ffca1be9af02f6e2/ 2023-02-13 16:03:48,192 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:48,192 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:48,192 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=3fbd1828b59558a2ffca1be9af02f6e2-41925e0f97654f9d9d8b9d9b862279f9 2023-02-13 16:03:48,192 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:48,193 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=3fbd1828b59558a2ffca1be9af02f6e2-a73391bf12eb4d6592c233775c347dd0 2023-02-13 16:03:48,193 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----------4a20bf98bd5b018f1a28063cb96011e2/ 2023-02-13 16:03:48,193 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:48,193 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:48,194 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=4a20bf98bd5b018f1a28063cb96011e2-11ff2bf9d6bf452caad8eb2ee8bd6f7a 2023-02-13 16:03:48,194 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:48,194 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=4a20bf98bd5b018f1a28063cb96011e2-3454f9659a12497ca7b7b4b5b5c860ca 2023-02-13 16:03:48,194 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----------5cc0251f2a699eafc3b80793e4405fde/ 2023-02-13 16:03:48,195 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:48,195 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:48,195 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=5cc0251f2a699eafc3b80793e4405fde-db2c1c939e804f42bf8f5562ba36f6eb 2023-02-13 16:03:48,195 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:48,195 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=5cc0251f2a699eafc3b80793e4405fde-950a3f54a47f47998e7449d5d5cffea8 2023-02-13 16:03:48,195 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----------b540b745c9d2f8a61806ca62f0ac6f9e/ 2023-02-13 16:03:48,196 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:48,196 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:48,196 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=b540b745c9d2f8a61806ca62f0ac6f9e-ef7991cb7b7b4fceab26c8b03c9661f5 2023-02-13 16:03:48,196 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:48,197 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=b540b745c9d2f8a61806ca62f0ac6f9e-53e5dac9ab624a149a296e032c3e6b25 2023-02-13 16:03:48,197 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----------ba17dfff6d375413082eb96ecdbfe764/ 2023-02-13 16:03:48,197 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:48,197 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:48,198 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=ba17dfff6d375413082eb96ecdbfe764-430864c194ea4909b68721aea9c08483 2023-02-13 16:03:48,198 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:48,198 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |----------------testWithMapReduce=ba17dfff6d375413082eb96ecdbfe764-a15631749e8f420fb8cd89ccb561ec1f 2023-02-13 16:03:48,198 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----------bee40e2fed40d46b5f11b2d0c6c6c9fa/ 2023-02-13 16:03:48,198 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:48,199 DEBUG [Listener at localhost/44363] util.CommonFSUtils(699): |----------d49e5e9dc9c8c646aa9e4a6b3553ba1f/ 2023-02-13 16:03:48,199 DEBUG [Listener at localhost/44363] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:48,199 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:48,200 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:48,200 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:48,200 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:49,102 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/hadoop-1103510373417695405.jar 2023-02-13 16:03:49,103 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:49,103 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:49,169 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/hadoop-2345591434374241940.jar 2023-02-13 16:03:49,170 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:49,170 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:49,170 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:49,171 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:49,171 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:49,172 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:49,172 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 16:03:49,172 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 16:03:49,173 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 16:03:49,173 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 16:03:49,173 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 16:03:49,174 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 16:03:49,174 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 16:03:49,175 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 16:03:49,175 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 16:03:49,176 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 16:03:49,176 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 16:03:49,176 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 16:03:49,177 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 16:03:49,177 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 16:03:49,178 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 16:03:49,243 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/hadoop-5803790200124662050.jar 2023-02-13 16:03:49,244 DEBUG [Listener at localhost/44363] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 16:03:49,249 WARN [Listener at localhost/44363] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 16:03:49,255 WARN [Listener at localhost/44363] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-13 16:03:49,261 INFO [Listener at localhost/44363] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 16:03:49,368 WARN [Listener at localhost/44363] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/mapreduce.cluster.local.dir/1676304229335/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 16:03:49,368 WARN [Listener at localhost/44363] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/mapreduce.cluster.local.dir/1676304229335/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 16:03:49,414 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:49,415 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:49,416 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:49,417 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:49,418 DEBUG [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f1 2023-02-13 16:03:49,419 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 397270e8716ff8c1be713a2aac73d948 columnFamilyName f1 2023-02-13 16:03:49,424 DEBUG [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f1/testWithMapReduce=397270e8716ff8c1be713a2aac73d948-9c59ff31cd50444cb129a76851bded54 2023-02-13 16:03:49,424 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] regionserver.HStore(310): Store=397270e8716ff8c1be713a2aac73d948/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,424 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 397270e8716ff8c1be713a2aac73d948 2023-02-13 16:03:49,425 DEBUG [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f2 2023-02-13 16:03:49,426 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 397270e8716ff8c1be713a2aac73d948 columnFamilyName f2 2023-02-13 16:03:49,430 DEBUG [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/397270e8716ff8c1be713a2aac73d948/f2/testWithMapReduce=397270e8716ff8c1be713a2aac73d948-70e2f4b0528f480e9c7a97c961cbff3d 2023-02-13 16:03:49,431 INFO [StoreOpener-397270e8716ff8c1be713a2aac73d948-1] regionserver.HStore(310): Store=397270e8716ff8c1be713a2aac73d948/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:49,431 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 397270e8716ff8c1be713a2aac73d948; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63413600, jitterRate=-0.055063724517822266}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:49,431 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 397270e8716ff8c1be713a2aac73d948: Writing region info on filesystem at 1676304229416Initializing all the Stores at 1676304229417 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229417Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229417Region opened successfully at 1676304229431 (+14 ms) 2023-02-13 16:03:49,466 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 397270e8716ff8c1be713a2aac73d948, disabling compactions & flushes 2023-02-13 16:03:49,466 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:49,467 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:49,467 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. after waiting 0 ms 2023-02-13 16:03:49,467 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:49,468 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,wWV,1676304223620.397270e8716ff8c1be713a2aac73d948. 2023-02-13 16:03:49,468 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 397270e8716ff8c1be713a2aac73d948: Waiting for close lock at 1676304229466Disabling compacts and flushes for region at 1676304229466Disabling writes for close at 1676304229467 (+1 ms)Writing region close event to WAL at 1676304229468 (+1 ms)Closed at 1676304229468 2023-02-13 16:03:49,471 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:49,471 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:49,473 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:49,475 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:49,476 DEBUG [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f1 2023-02-13 16:03:49,476 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b2a1bd67c080415da09adb5d6485652 columnFamilyName f1 2023-02-13 16:03:49,484 DEBUG [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f1/testWithMapReduce=0b2a1bd67c080415da09adb5d6485652-dcbd1ab9005d4382a0e9146db8db9b7a 2023-02-13 16:03:49,484 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] regionserver.HStore(310): Store=0b2a1bd67c080415da09adb5d6485652/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,484 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 0b2a1bd67c080415da09adb5d6485652 2023-02-13 16:03:49,485 DEBUG [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f2 2023-02-13 16:03:49,485 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b2a1bd67c080415da09adb5d6485652 columnFamilyName f2 2023-02-13 16:03:49,489 DEBUG [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/0b2a1bd67c080415da09adb5d6485652/f2/testWithMapReduce=0b2a1bd67c080415da09adb5d6485652-e9e9d806cf8f4b9792ac5158bdfd3dbb 2023-02-13 16:03:49,490 INFO [StoreOpener-0b2a1bd67c080415da09adb5d6485652-1] regionserver.HStore(310): Store=0b2a1bd67c080415da09adb5d6485652/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:49,490 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 0b2a1bd67c080415da09adb5d6485652; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66781553, jitterRate=-0.00487731397151947}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:49,490 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 0b2a1bd67c080415da09adb5d6485652: Writing region info on filesystem at 1676304229473Initializing all the Stores at 1676304229474 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229474Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229474Region opened successfully at 1676304229490 (+16 ms) 2023-02-13 16:03:49,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 0b2a1bd67c080415da09adb5d6485652, disabling compactions & flushes 2023-02-13 16:03:49,526 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:49,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:49,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. after waiting 0 ms 2023-02-13 16:03:49,526 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:49,527 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,q\x11\x10,1676304223620.0b2a1bd67c080415da09adb5d6485652. 2023-02-13 16:03:49,527 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 0b2a1bd67c080415da09adb5d6485652: Waiting for close lock at 1676304229526Disabling compacts and flushes for region at 1676304229526Disabling writes for close at 1676304229526Writing region close event to WAL at 1676304229527 (+1 ms)Closed at 1676304229527 2023-02-13 16:03:49,531 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:49,532 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:49,533 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:49,535 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:49,536 DEBUG [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f1 2023-02-13 16:03:49,536 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cc0251f2a699eafc3b80793e4405fde columnFamilyName f1 2023-02-13 16:03:49,541 DEBUG [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f1/testWithMapReduce=5cc0251f2a699eafc3b80793e4405fde-db2c1c939e804f42bf8f5562ba36f6eb 2023-02-13 16:03:49,542 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] regionserver.HStore(310): Store=5cc0251f2a699eafc3b80793e4405fde/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,542 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5cc0251f2a699eafc3b80793e4405fde 2023-02-13 16:03:49,543 DEBUG [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f2 2023-02-13 16:03:49,543 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5cc0251f2a699eafc3b80793e4405fde columnFamilyName f2 2023-02-13 16:03:49,548 DEBUG [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/5cc0251f2a699eafc3b80793e4405fde/f2/testWithMapReduce=5cc0251f2a699eafc3b80793e4405fde-950a3f54a47f47998e7449d5d5cffea8 2023-02-13 16:03:49,548 INFO [StoreOpener-5cc0251f2a699eafc3b80793e4405fde-1] regionserver.HStore(310): Store=5cc0251f2a699eafc3b80793e4405fde/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,549 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:49,549 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 5cc0251f2a699eafc3b80793e4405fde; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60144112, jitterRate=-0.10378289222717285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:49,549 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 5cc0251f2a699eafc3b80793e4405fde: Writing region info on filesystem at 1676304229533Initializing all the Stores at 1676304229534 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229534Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229534Region opened successfully at 1676304229549 (+15 ms) 2023-02-13 16:03:49,590 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 5cc0251f2a699eafc3b80793e4405fde, disabling compactions & flushes 2023-02-13 16:03:49,591 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:49,591 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:49,591 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. after waiting 0 ms 2023-02-13 16:03:49,591 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:49,592 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,m\xED\xED,1676304223620.5cc0251f2a699eafc3b80793e4405fde. 2023-02-13 16:03:49,592 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 5cc0251f2a699eafc3b80793e4405fde: Waiting for close lock at 1676304229590Disabling compacts and flushes for region at 1676304229590Disabling writes for close at 1676304229591 (+1 ms)Writing region close event to WAL at 1676304229592 (+1 ms)Closed at 1676304229592 2023-02-13 16:03:49,596 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:49,596 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:49,602 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:49,604 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:49,605 DEBUG [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f1 2023-02-13 16:03:49,605 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b540b745c9d2f8a61806ca62f0ac6f9e columnFamilyName f1 2023-02-13 16:03:49,610 DEBUG [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f1/testWithMapReduce=b540b745c9d2f8a61806ca62f0ac6f9e-ef7991cb7b7b4fceab26c8b03c9661f5 2023-02-13 16:03:49,610 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] regionserver.HStore(310): Store=b540b745c9d2f8a61806ca62f0ac6f9e/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,610 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b540b745c9d2f8a61806ca62f0ac6f9e 2023-02-13 16:03:49,611 DEBUG [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f2 2023-02-13 16:03:49,612 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b540b745c9d2f8a61806ca62f0ac6f9e columnFamilyName f2 2023-02-13 16:03:49,616 DEBUG [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/b540b745c9d2f8a61806ca62f0ac6f9e/f2/testWithMapReduce=b540b745c9d2f8a61806ca62f0ac6f9e-53e5dac9ab624a149a296e032c3e6b25 2023-02-13 16:03:49,616 INFO [StoreOpener-b540b745c9d2f8a61806ca62f0ac6f9e-1] regionserver.HStore(310): Store=b540b745c9d2f8a61806ca62f0ac6f9e/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,617 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:49,617 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b540b745c9d2f8a61806ca62f0ac6f9e; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67990468, jitterRate=0.01313692331314087}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:49,617 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b540b745c9d2f8a61806ca62f0ac6f9e: Writing region info on filesystem at 1676304229602Initializing all the Stores at 1676304229603 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229603Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229603Region opened successfully at 1676304229617 (+14 ms) 2023-02-13 16:03:49,644 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b540b745c9d2f8a61806ca62f0ac6f9e, disabling compactions & flushes 2023-02-13 16:03:49,645 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:49,645 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:49,645 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. after waiting 0 ms 2023-02-13 16:03:49,645 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:49,646 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,j\xCA\xCA,1676304223620.b540b745c9d2f8a61806ca62f0ac6f9e. 2023-02-13 16:03:49,646 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b540b745c9d2f8a61806ca62f0ac6f9e: Waiting for close lock at 1676304229644Disabling compacts and flushes for region at 1676304229644Disabling writes for close at 1676304229645 (+1 ms)Writing region close event to WAL at 1676304229646 (+1 ms)Closed at 1676304229646 2023-02-13 16:03:49,649 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:49,649 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:49,650 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:49,652 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:49,653 DEBUG [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f1 2023-02-13 16:03:49,653 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a20bf98bd5b018f1a28063cb96011e2 columnFamilyName f1 2023-02-13 16:03:49,658 DEBUG [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f1/testWithMapReduce=4a20bf98bd5b018f1a28063cb96011e2-11ff2bf9d6bf452caad8eb2ee8bd6f7a 2023-02-13 16:03:49,658 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] regionserver.HStore(310): Store=4a20bf98bd5b018f1a28063cb96011e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,658 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4a20bf98bd5b018f1a28063cb96011e2 2023-02-13 16:03:49,659 DEBUG [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f2 2023-02-13 16:03:49,660 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a20bf98bd5b018f1a28063cb96011e2 columnFamilyName f2 2023-02-13 16:03:49,666 DEBUG [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/4a20bf98bd5b018f1a28063cb96011e2/f2/testWithMapReduce=4a20bf98bd5b018f1a28063cb96011e2-3454f9659a12497ca7b7b4b5b5c860ca 2023-02-13 16:03:49,666 INFO [StoreOpener-4a20bf98bd5b018f1a28063cb96011e2-1] regionserver.HStore(310): Store=4a20bf98bd5b018f1a28063cb96011e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:49,666 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 4a20bf98bd5b018f1a28063cb96011e2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64599249, jitterRate=-0.037396177649497986}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:49,666 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 4a20bf98bd5b018f1a28063cb96011e2: Writing region info on filesystem at 1676304229650Initializing all the Stores at 1676304229651 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229651Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229651Region opened successfully at 1676304229666 (+15 ms) 2023-02-13 16:03:49,693 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 4a20bf98bd5b018f1a28063cb96011e2, disabling compactions & flushes 2023-02-13 16:03:49,693 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:49,693 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:49,694 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. after waiting 0 ms 2023-02-13 16:03:49,694 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:49,694 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,d\x84\x84,1676304223620.4a20bf98bd5b018f1a28063cb96011e2. 2023-02-13 16:03:49,694 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 4a20bf98bd5b018f1a28063cb96011e2: Waiting for close lock at 1676304229693Disabling compacts and flushes for region at 1676304229693Disabling writes for close at 1676304229694 (+1 ms)Writing region close event to WAL at 1676304229694Closed at 1676304229694 2023-02-13 16:03:49,698 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:49,698 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:49,700 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:49,701 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:49,702 DEBUG [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f1 2023-02-13 16:03:49,703 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fbd1828b59558a2ffca1be9af02f6e2 columnFamilyName f1 2023-02-13 16:03:49,707 DEBUG [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f1/testWithMapReduce=3fbd1828b59558a2ffca1be9af02f6e2-41925e0f97654f9d9d8b9d9b862279f9 2023-02-13 16:03:49,708 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] regionserver.HStore(310): Store=3fbd1828b59558a2ffca1be9af02f6e2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,708 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3fbd1828b59558a2ffca1be9af02f6e2 2023-02-13 16:03:49,709 DEBUG [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f2 2023-02-13 16:03:49,709 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3fbd1828b59558a2ffca1be9af02f6e2 columnFamilyName f2 2023-02-13 16:03:49,714 DEBUG [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/3fbd1828b59558a2ffca1be9af02f6e2/f2/testWithMapReduce=3fbd1828b59558a2ffca1be9af02f6e2-a73391bf12eb4d6592c233775c347dd0 2023-02-13 16:03:49,714 INFO [StoreOpener-3fbd1828b59558a2ffca1be9af02f6e2-1] regionserver.HStore(310): Store=3fbd1828b59558a2ffca1be9af02f6e2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,714 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:49,714 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 3fbd1828b59558a2ffca1be9af02f6e2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59529354, jitterRate=-0.11294350028038025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:49,715 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 3fbd1828b59558a2ffca1be9af02f6e2: Writing region info on filesystem at 1676304229700Initializing all the Stores at 1676304229701 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229701Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229701Region opened successfully at 1676304229714 (+13 ms) 2023-02-13 16:03:49,749 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 3fbd1828b59558a2ffca1be9af02f6e2, disabling compactions & flushes 2023-02-13 16:03:49,749 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:49,749 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:49,749 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. after waiting 0 ms 2023-02-13 16:03:49,749 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:49,750 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,g\xA7\xA7,1676304223620.3fbd1828b59558a2ffca1be9af02f6e2. 2023-02-13 16:03:49,750 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 3fbd1828b59558a2ffca1be9af02f6e2: Waiting for close lock at 1676304229749Disabling compacts and flushes for region at 1676304229749Disabling writes for close at 1676304229749Writing region close event to WAL at 1676304229750 (+1 ms)Closed at 1676304229750 2023-02-13 16:03:49,753 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:49,753 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:49,754 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:49,756 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:49,758 DEBUG [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa/f1 2023-02-13 16:03:49,758 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bee40e2fed40d46b5f11b2d0c6c6c9fa columnFamilyName f1 2023-02-13 16:03:49,759 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] regionserver.HStore(310): Store=bee40e2fed40d46b5f11b2d0c6c6c9fa/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,759 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region bee40e2fed40d46b5f11b2d0c6c6c9fa 2023-02-13 16:03:49,760 DEBUG [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/bee40e2fed40d46b5f11b2d0c6c6c9fa/f2 2023-02-13 16:03:49,760 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bee40e2fed40d46b5f11b2d0c6c6c9fa columnFamilyName f2 2023-02-13 16:03:49,761 INFO [StoreOpener-bee40e2fed40d46b5f11b2d0c6c6c9fa-1] regionserver.HStore(310): Store=bee40e2fed40d46b5f11b2d0c6c6c9fa/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,761 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:49,761 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened bee40e2fed40d46b5f11b2d0c6c6c9fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66003860, jitterRate=-0.016465842723846436}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:49,761 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for bee40e2fed40d46b5f11b2d0c6c6c9fa: Writing region info on filesystem at 1676304229755Initializing all the Stores at 1676304229755Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229755Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229756 (+1 ms)Region opened successfully at 1676304229761 (+5 ms) 2023-02-13 16:03:49,788 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing bee40e2fed40d46b5f11b2d0c6c6c9fa, disabling compactions & flushes 2023-02-13 16:03:49,788 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:49,788 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:49,788 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. after waiting 0 ms 2023-02-13 16:03:49,788 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:49,789 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,zz{,1676304223620.bee40e2fed40d46b5f11b2d0c6c6c9fa. 2023-02-13 16:03:49,789 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for bee40e2fed40d46b5f11b2d0c6c6c9fa: Waiting for close lock at 1676304229788Disabling compacts and flushes for region at 1676304229788Disabling writes for close at 1676304229788Writing region close event to WAL at 1676304229789 (+1 ms)Closed at 1676304229789 2023-02-13 16:03:49,791 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:49,792 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:49,793 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:49,795 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:49,796 DEBUG [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f1 2023-02-13 16:03:49,796 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 121d5e32312bbfb25df57897b25d68c2 columnFamilyName f1 2023-02-13 16:03:49,801 DEBUG [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f1/testWithMapReduce=121d5e32312bbfb25df57897b25d68c2-39849fadaa6a4023889a62bee66e49da 2023-02-13 16:03:49,801 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] regionserver.HStore(310): Store=121d5e32312bbfb25df57897b25d68c2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,801 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 121d5e32312bbfb25df57897b25d68c2 2023-02-13 16:03:49,802 DEBUG [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f2 2023-02-13 16:03:49,802 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 121d5e32312bbfb25df57897b25d68c2 columnFamilyName f2 2023-02-13 16:03:49,807 DEBUG [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/121d5e32312bbfb25df57897b25d68c2/f2/testWithMapReduce=121d5e32312bbfb25df57897b25d68c2-18f61dd517a14855a2f76d3e837b8181 2023-02-13 16:03:49,807 INFO [StoreOpener-121d5e32312bbfb25df57897b25d68c2-1] regionserver.HStore(310): Store=121d5e32312bbfb25df57897b25d68c2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,807 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:49,807 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened 121d5e32312bbfb25df57897b25d68c2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66357511, jitterRate=-0.011196032166481018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:49,807 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for 121d5e32312bbfb25df57897b25d68c2: Writing region info on filesystem at 1676304229793Initializing all the Stores at 1676304229794 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229794Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229794Region opened successfully at 1676304229807 (+13 ms) 2023-02-13 16:03:49,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing 121d5e32312bbfb25df57897b25d68c2, disabling compactions & flushes 2023-02-13 16:03:49,836 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:49,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:49,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. after waiting 0 ms 2023-02-13 16:03:49,836 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:49,837 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,aaa,1676304223620.121d5e32312bbfb25df57897b25d68c2. 2023-02-13 16:03:49,837 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for 121d5e32312bbfb25df57897b25d68c2: Waiting for close lock at 1676304229836Disabling compacts and flushes for region at 1676304229836Disabling writes for close at 1676304229836Writing region close event to WAL at 1676304229837 (+1 ms)Closed at 1676304229837 2023-02-13 16:03:49,841 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:49,841 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:49,845 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:49,849 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:49,850 DEBUG [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f1 2023-02-13 16:03:49,850 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba17dfff6d375413082eb96ecdbfe764 columnFamilyName f1 2023-02-13 16:03:49,855 DEBUG [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f1/testWithMapReduce=ba17dfff6d375413082eb96ecdbfe764-430864c194ea4909b68721aea9c08483 2023-02-13 16:03:49,855 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] regionserver.HStore(310): Store=ba17dfff6d375413082eb96ecdbfe764/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,855 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region ba17dfff6d375413082eb96ecdbfe764 2023-02-13 16:03:49,856 DEBUG [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f2 2023-02-13 16:03:49,857 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba17dfff6d375413082eb96ecdbfe764 columnFamilyName f2 2023-02-13 16:03:49,861 DEBUG [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] regionserver.HStore(539): loaded hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/ba17dfff6d375413082eb96ecdbfe764/f2/testWithMapReduce=ba17dfff6d375413082eb96ecdbfe764-a15631749e8f420fb8cd89ccb561ec1f 2023-02-13 16:03:49,861 INFO [StoreOpener-ba17dfff6d375413082eb96ecdbfe764-1] regionserver.HStore(310): Store=ba17dfff6d375413082eb96ecdbfe764/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,861 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:49,861 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened ba17dfff6d375413082eb96ecdbfe764; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71779921, jitterRate=0.06960417330265045}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:49,861 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for ba17dfff6d375413082eb96ecdbfe764: Writing region info on filesystem at 1676304229845Initializing all the Stores at 1676304229846 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229846Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229848 (+2 ms)Region opened successfully at 1676304229861 (+13 ms) 2023-02-13 16:03:49,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing ba17dfff6d375413082eb96ecdbfe764, disabling compactions & flushes 2023-02-13 16:03:49,895 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:49,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:49,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. after waiting 0 ms 2023-02-13 16:03:49,895 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:49,896 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,t43,1676304223620.ba17dfff6d375413082eb96ecdbfe764. 2023-02-13 16:03:49,896 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for ba17dfff6d375413082eb96ecdbfe764: Waiting for close lock at 1676304229895Disabling compacts and flushes for region at 1676304229895Disabling writes for close at 1676304229895Writing region close event to WAL at 1676304229896 (+1 ms)Closed at 1676304229896 2023-02-13 16:03:49,899 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:49,899 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:03:49,900 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:49,903 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:49,904 DEBUG [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f/f1 2023-02-13 16:03:49,905 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d49e5e9dc9c8c646aa9e4a6b3553ba1f columnFamilyName f1 2023-02-13 16:03:49,905 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] regionserver.HStore(310): Store=d49e5e9dc9c8c646aa9e4a6b3553ba1f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,905 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d49e5e9dc9c8c646aa9e4a6b3553ba1f 2023-02-13 16:03:49,906 DEBUG [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35349/user/jenkins/test-data/4edae7d8-9110-eba3-5a35-2e1c49dd8a01/testWithMapReduceAndOfflineHBaseMultiRegion/0bc775bd-8c65-462f-afeb-8cc8f63dba82/data/default/testWithMapReduce/d49e5e9dc9c8c646aa9e4a6b3553ba1f/f2 2023-02-13 16:03:49,907 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d49e5e9dc9c8c646aa9e4a6b3553ba1f columnFamilyName f2 2023-02-13 16:03:49,907 INFO [StoreOpener-d49e5e9dc9c8c646aa9e4a6b3553ba1f-1] regionserver.HStore(310): Store=d49e5e9dc9c8c646aa9e4a6b3553ba1f/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:49,907 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:49,908 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened d49e5e9dc9c8c646aa9e4a6b3553ba1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64231361, jitterRate=-0.04287813603878021}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:49,908 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for d49e5e9dc9c8c646aa9e4a6b3553ba1f: Writing region info on filesystem at 1676304229900Initializing all the Stores at 1676304229901 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229901Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304229901Region opened successfully at 1676304229908 (+7 ms) 2023-02-13 16:03:49,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing d49e5e9dc9c8c646aa9e4a6b3553ba1f, disabling compactions & flushes 2023-02-13 16:03:49,925 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:49,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:49,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. after waiting 0 ms 2023-02-13 16:03:49,925 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:49,926 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304223620.d49e5e9dc9c8c646aa9e4a6b3553ba1f. 2023-02-13 16:03:49,926 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for d49e5e9dc9c8c646aa9e4a6b3553ba1f: Waiting for close lock at 1676304229925Disabling compacts and flushes for region at 1676304229925Disabling writes for close at 1676304229925Writing region close event to WAL at 1676304229926 (+1 ms)Closed at 1676304229926 2023-02-13 16:03:50,416 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 16:03:50,416 WARN [Listener at localhost/44363] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:03:50,419 INFO [Listener at localhost/44363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:03:50,521 WARN [BP-14289925-172.31.14.131-1676304221386 heartbeating to localhost/127.0.0.1:35349] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:03:50,521 WARN [BP-14289925-172.31.14.131-1676304221386 heartbeating to localhost/127.0.0.1:35349] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-14289925-172.31.14.131-1676304221386 (Datanode Uuid cf7954f6-b477-4cac-a222-7a42456d506c) service to localhost/127.0.0.1:35349 2023-02-13 16:03:50,523 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/cluster_4a3600c5-5432-cbb0-29fb-f1504a30eab5/dfs/data/data3/current/BP-14289925-172.31.14.131-1676304221386] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:50,523 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/cluster_4a3600c5-5432-cbb0-29fb-f1504a30eab5/dfs/data/data4/current/BP-14289925-172.31.14.131-1676304221386] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:50,524 WARN [Listener at localhost/44363] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:03:50,527 INFO [Listener at localhost/44363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:03:50,631 WARN [BP-14289925-172.31.14.131-1676304221386 heartbeating to localhost/127.0.0.1:35349] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:03:50,631 WARN [BP-14289925-172.31.14.131-1676304221386 heartbeating to localhost/127.0.0.1:35349] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-14289925-172.31.14.131-1676304221386 (Datanode Uuid d280f4e4-7c3a-4204-8cb5-9c02f831ff7f) service to localhost/127.0.0.1:35349 2023-02-13 16:03:50,631 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/cluster_4a3600c5-5432-cbb0-29fb-f1504a30eab5/dfs/data/data1/current/BP-14289925-172.31.14.131-1676304221386] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:50,632 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/cluster_4a3600c5-5432-cbb0-29fb-f1504a30eab5/dfs/data/data2/current/BP-14289925-172.31.14.131-1676304221386] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:50,641 INFO [Listener at localhost/44363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:03:50,763 INFO [Listener at localhost/44363] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 16:03:50,810 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 16:03:50,823 INFO [Listener at localhost/44363] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceAndOfflineHBaseMultiRegion Thread=155 (was 104) Potentially hanging thread: RS-EventLoopGroup-6-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:35349 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:35349 from jenkins.hfs.3 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-6-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:35349 from jenkins.hfs.2 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/44363 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-6-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40869,1676304222059)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-8-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-7-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.2@localhost:35349 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-8-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-7-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:35349 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-9-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'DataNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-7-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:35349 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-6-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.3@localhost:35349 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=529 (was 536), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=305 (was 252) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=1662 (was 1871) 2023-02-13 16:03:50,834 INFO [Listener at localhost/44363] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=155, OpenFileDescriptor=529, MaxFileDescriptor=60000, SystemLoadAverage=305, ProcessCount=165, AvailableMemoryMB=1662 2023-02-13 16:03:50,845 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/hadoop.log.dir so I do NOT create it in target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7 2023-02-13 16:03:50,845 WARN [Listener at localhost/44363] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 16:03:50,845 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/hadoop.tmp.dir so I do NOT create it in target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7 2023-02-13 16:03:50,845 WARN [Listener at localhost/44363] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/74076d46-0e61-0ab8-e4bc-0aa6c8527af3/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 16:03:50,845 DEBUG [Listener at localhost/44363] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7 2023-02-13 16:03:50,845 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 16:03:50,845 INFO [Listener at localhost/44363] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/cluster_7a5a527d-2c9a-337c-3b61-683b96b45d10, deleteOnExit=true 2023-02-13 16:03:50,845 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 16:03:50,846 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/test.cache.data in system properties and HBase conf 2023-02-13 16:03:50,846 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 16:03:50,846 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/hadoop.log.dir in system properties and HBase conf 2023-02-13 16:03:50,846 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 16:03:50,846 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 16:03:50,846 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 16:03:50,846 DEBUG [Listener at localhost/44363] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 16:03:50,846 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:03:50,846 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/nfs.dump.dir in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/java.io.tmpdir in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:03:50,847 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 16:03:50,848 INFO [Listener at localhost/44363] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 16:03:50,852 WARN [Listener at localhost/44363] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:03:50,852 WARN [Listener at localhost/44363] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:03:50,898 WARN [Listener at localhost/44363] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:50,900 INFO [Listener at localhost/44363] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:50,907 INFO [Listener at localhost/44363] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/java.io.tmpdir/Jetty_localhost_42085_hdfs____ffc3a1/webapp 2023-02-13 16:03:50,999 INFO [Listener at localhost/44363] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42085 2023-02-13 16:03:51,004 WARN [Listener at localhost/44363] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:03:51,004 WARN [Listener at localhost/44363] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:03:51,146 WARN [Listener at localhost/41017] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:51,161 WARN [Listener at localhost/41017] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:03:51,163 WARN [Listener at localhost/41017] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:51,164 INFO [Listener at localhost/41017] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:51,173 INFO [Listener at localhost/41017] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/java.io.tmpdir/Jetty_localhost_39565_datanode____.yzxzez/webapp 2023-02-13 16:03:51,266 INFO [Listener at localhost/41017] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39565 2023-02-13 16:03:51,273 WARN [Listener at localhost/44115] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:51,291 WARN [Listener at localhost/44115] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:03:51,294 WARN [Listener at localhost/44115] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:51,295 INFO [Listener at localhost/44115] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:51,299 INFO [Listener at localhost/44115] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/java.io.tmpdir/Jetty_localhost_32975_datanode____.ql82dd/webapp 2023-02-13 16:03:51,372 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5feac1a75c8e96d9: Processing first storage report for DS-41d69a91-ea47-4273-ae99-647a452bae12 from datanode 269487d0-1ded-4e6f-a432-d558cae09e72 2023-02-13 16:03:51,372 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5feac1a75c8e96d9: from storage DS-41d69a91-ea47-4273-ae99-647a452bae12 node DatanodeRegistration(127.0.0.1:38105, datanodeUuid=269487d0-1ded-4e6f-a432-d558cae09e72, infoPort=39213, infoSecurePort=0, ipcPort=44115, storageInfo=lv=-57;cid=testClusterID;nsid=1420138965;c=1676304230854), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:51,372 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5feac1a75c8e96d9: Processing first storage report for DS-0ab005cc-e248-4793-bbb4-0818f7fe9f25 from datanode 269487d0-1ded-4e6f-a432-d558cae09e72 2023-02-13 16:03:51,372 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5feac1a75c8e96d9: from storage DS-0ab005cc-e248-4793-bbb4-0818f7fe9f25 node DatanodeRegistration(127.0.0.1:38105, datanodeUuid=269487d0-1ded-4e6f-a432-d558cae09e72, infoPort=39213, infoSecurePort=0, ipcPort=44115, storageInfo=lv=-57;cid=testClusterID;nsid=1420138965;c=1676304230854), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:51,410 INFO [Listener at localhost/44115] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:32975 2023-02-13 16:03:51,420 WARN [Listener at localhost/34983] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:51,514 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4b11158a7fdd4ce3: Processing first storage report for DS-d45fb72f-a73b-44d3-b692-ba98338cfcad from datanode df88c89b-4962-49fc-9db5-e251cac89627 2023-02-13 16:03:51,514 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4b11158a7fdd4ce3: from storage DS-d45fb72f-a73b-44d3-b692-ba98338cfcad node DatanodeRegistration(127.0.0.1:38233, datanodeUuid=df88c89b-4962-49fc-9db5-e251cac89627, infoPort=36443, infoSecurePort=0, ipcPort=34983, storageInfo=lv=-57;cid=testClusterID;nsid=1420138965;c=1676304230854), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:51,514 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4b11158a7fdd4ce3: Processing first storage report for DS-b8400663-4b0a-438e-8a5a-81c6a7549cbc from datanode df88c89b-4962-49fc-9db5-e251cac89627 2023-02-13 16:03:51,514 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4b11158a7fdd4ce3: from storage DS-b8400663-4b0a-438e-8a5a-81c6a7549cbc node DatanodeRegistration(127.0.0.1:38233, datanodeUuid=df88c89b-4962-49fc-9db5-e251cac89627, infoPort=36443, infoSecurePort=0, ipcPort=34983, storageInfo=lv=-57;cid=testClusterID;nsid=1420138965;c=1676304230854), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:51,535 DEBUG [Listener at localhost/34983] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7 2023-02-13 16:03:51,537 INFO [Listener at localhost/34983] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/cluster_7a5a527d-2c9a-337c-3b61-683b96b45d10/zookeeper_0, clientPort=51956, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/cluster_7a5a527d-2c9a-337c-3b61-683b96b45d10/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/cluster_7a5a527d-2c9a-337c-3b61-683b96b45d10/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 16:03:51,538 INFO [Listener at localhost/34983] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51956 2023-02-13 16:03:51,539 INFO [Listener at localhost/34983] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,539 INFO [Listener at localhost/34983] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,551 INFO [Listener at localhost/34983] util.FSUtils(479): Created version file at hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a with version=8 2023-02-13 16:03:51,551 INFO [Listener at localhost/34983] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,552 INFO [Listener at localhost/34983] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,553 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41017/user/jenkins/test-data/c7595805-ca29-d3e4-1aa6-93297ccc5994/hbase-staging 2023-02-13 16:03:51,555 INFO [Listener at localhost/34983] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:51,555 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:51,555 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:51,555 INFO [Listener at localhost/34983] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:51,555 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:51,556 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:51,556 INFO [Listener at localhost/34983] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:51,557 INFO [Listener at localhost/34983] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41951 2023-02-13 16:03:51,557 INFO [Listener at localhost/34983] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,558 INFO [Listener at localhost/34983] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,559 INFO [Listener at localhost/34983] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41951 connecting to ZooKeeper ensemble=127.0.0.1:51956 2023-02-13 16:03:51,565 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:419510x0, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:51,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:41951-0x1004e6c96360000 connected 2023-02-13 16:03:51,586 DEBUG [Listener at localhost/34983] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:51,586 DEBUG [Listener at localhost/34983] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:51,587 DEBUG [Listener at localhost/34983] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:51,587 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41951 2023-02-13 16:03:51,588 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41951 2023-02-13 16:03:51,588 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41951 2023-02-13 16:03:51,590 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41951 2023-02-13 16:03:51,592 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41951 2023-02-13 16:03:51,592 INFO [Listener at localhost/34983] master.HMaster(439): hbase.rootdir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a, hbase.cluster.distributed=false 2023-02-13 16:03:51,605 INFO [Listener at localhost/34983] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:51,605 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:51,605 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:51,605 INFO [Listener at localhost/34983] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:51,605 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:51,605 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:51,605 INFO [Listener at localhost/34983] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:51,607 INFO [Listener at localhost/34983] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45217 2023-02-13 16:03:51,607 INFO [Listener at localhost/34983] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:03:51,609 DEBUG [Listener at localhost/34983] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:51,609 INFO [Listener at localhost/34983] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,610 INFO [Listener at localhost/34983] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,611 INFO [Listener at localhost/34983] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45217 connecting to ZooKeeper ensemble=127.0.0.1:51956 2023-02-13 16:03:51,614 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:452170x0, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:51,615 DEBUG [Listener at localhost/34983] zookeeper.ZKUtil(164): regionserver:452170x0, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:51,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45217-0x1004e6c96360001 connected 2023-02-13 16:03:51,616 DEBUG [Listener at localhost/34983] zookeeper.ZKUtil(164): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:51,617 DEBUG [Listener at localhost/34983] zookeeper.ZKUtil(164): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:51,620 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45217 2023-02-13 16:03:51,620 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45217 2023-02-13 16:03:51,621 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45217 2023-02-13 16:03:51,624 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45217 2023-02-13 16:03:51,624 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45217 2023-02-13 16:03:51,635 INFO [Listener at localhost/34983] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:51,635 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:51,636 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:51,636 INFO [Listener at localhost/34983] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:51,636 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:51,636 INFO [Listener at localhost/34983] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:51,636 INFO [Listener at localhost/34983] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:51,639 INFO [Listener at localhost/34983] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36263 2023-02-13 16:03:51,639 INFO [Listener at localhost/34983] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:03:51,640 DEBUG [Listener at localhost/34983] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:51,641 INFO [Listener at localhost/34983] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,642 INFO [Listener at localhost/34983] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,642 INFO [Listener at localhost/34983] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36263 connecting to ZooKeeper ensemble=127.0.0.1:51956 2023-02-13 16:03:51,645 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:362630x0, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:51,647 DEBUG [Listener at localhost/34983] zookeeper.ZKUtil(164): regionserver:362630x0, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:51,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36263-0x1004e6c96360002 connected 2023-02-13 16:03:51,648 DEBUG [Listener at localhost/34983] zookeeper.ZKUtil(164): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:51,649 DEBUG [Listener at localhost/34983] zookeeper.ZKUtil(164): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:51,649 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36263 2023-02-13 16:03:51,649 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36263 2023-02-13 16:03:51,652 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36263 2023-02-13 16:03:51,654 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36263 2023-02-13 16:03:51,654 DEBUG [Listener at localhost/34983] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36263 2023-02-13 16:03:51,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41951,1676304231555 2023-02-13 16:03:51,657 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:03:51,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41951,1676304231555 2023-02-13 16:03:51,659 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:51,659 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:51,659 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:51,659 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:51,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:03:51,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41951,1676304231555 from backup master directory 2023-02-13 16:03:51,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:03:51,662 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41951,1676304231555 2023-02-13 16:03:51,662 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:03:51,662 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:51,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,41951,1676304231555 2023-02-13 16:03:51,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/hbase.id with ID: e36ef470-3c69-47e8-bdb4-7ed2cb9b91fa 2023-02-13 16:03:51,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:51,688 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:51,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x492aa2c3 to 127.0.0.1:51956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:51,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dccc53e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:51,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:51,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 16:03:51,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:51,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/data/master/store-tmp 2023-02-13 16:03:51,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:51,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:03:51,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:51,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:51,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:03:51,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:51,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:51,717 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304231717Disabling compacts and flushes for region at 1676304231717Disabling writes for close at 1676304231717Writing region close event to WAL at 1676304231717Closed at 1676304231717 2023-02-13 16:03:51,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/WALs/jenkins-hbase4.apache.org,41951,1676304231555 2023-02-13 16:03:51,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41951%2C1676304231555, suffix=, logDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/WALs/jenkins-hbase4.apache.org,41951,1676304231555, archiveDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/oldWALs, maxLogs=10 2023-02-13 16:03:51,735 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38233,DS-d45fb72f-a73b-44d3-b692-ba98338cfcad,DISK] 2023-02-13 16:03:51,736 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38105,DS-41d69a91-ea47-4273-ae99-647a452bae12,DISK] 2023-02-13 16:03:51,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/WALs/jenkins-hbase4.apache.org,41951,1676304231555/jenkins-hbase4.apache.org%2C41951%2C1676304231555.1676304231721 2023-02-13 16:03:51,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38233,DS-d45fb72f-a73b-44d3-b692-ba98338cfcad,DISK], DatanodeInfoWithStorage[127.0.0.1:38105,DS-41d69a91-ea47-4273-ae99-647a452bae12,DISK]] 2023-02-13 16:03:51,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:51,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:51,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:51,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:51,742 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:51,744 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 16:03:51,744 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 16:03:51,744 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:51,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:51,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:51,747 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:51,752 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:51,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61751807, jitterRate=-0.07982636988162994}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:03:51,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676304231741Initializing all the Stores at 1676304231742 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304231742Cleaning up temporary data from old regions at 1676304231746 (+4 ms)Cleaning up detritus from prior splits at 1676304231746Region opened successfully at 1676304231753 (+7 ms) 2023-02-13 16:03:51,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 16:03:51,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 16:03:51,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 16:03:51,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 16:03:51,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 16:03:51,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 16:03:51,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 16:03:51,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 16:03:51,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 16:03:51,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 16:03:51,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 16:03:51,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 16:03:51,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 16:03:51,773 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 16:03:51,775 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:51,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 16:03:51,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 16:03:51,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 16:03:51,778 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:51,778 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:51,778 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:51,778 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:51,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,41951,1676304231555, sessionid=0x1004e6c96360000, setting cluster-up flag (Was=false) 2023-02-13 16:03:51,783 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:51,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 16:03:51,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41951,1676304231555 2023-02-13 16:03:51,792 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:51,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 16:03:51,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41951,1676304231555 2023-02-13 16:03:51,797 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.hbase-snapshot/.tmp 2023-02-13 16:03:51,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:51,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:51,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:51,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:51,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:51,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 16:03:51,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:51,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676304261804 2023-02-13 16:03:51,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 16:03:51,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 16:03:51,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 16:03:51,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 16:03:51,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 16:03:51,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 16:03:51,805 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:51,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,805 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 16:03:51,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 16:03:51,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 16:03:51,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 16:03:51,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 16:03:51,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 16:03:51,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304231806,5,FailOnTimeoutGroup] 2023-02-13 16:03:51,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304231806,5,FailOnTimeoutGroup] 2023-02-13 16:03:51,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,806 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:51,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 16:03:51,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,821 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:51,822 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:51,822 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a 2023-02-13 16:03:51,832 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:51,832 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:03:51,834 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/info 2023-02-13 16:03:51,834 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:03:51,834 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:51,835 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:03:51,836 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:51,836 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:03:51,836 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:51,836 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:03:51,837 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/table 2023-02-13 16:03:51,837 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:03:51,838 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:51,838 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740 2023-02-13 16:03:51,838 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740 2023-02-13 16:03:51,840 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:03:51,841 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:03:51,842 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:51,842 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62141672, jitterRate=-0.07401692867279053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:03:51,843 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676304231832Initializing all the Stores at 1676304231832Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304231832Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304231832Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304231832Cleaning up temporary data from old regions at 1676304231839 (+7 ms)Cleaning up detritus from prior splits at 1676304231839Region opened successfully at 1676304231843 (+4 ms) 2023-02-13 16:03:51,843 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:03:51,843 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:03:51,843 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:03:51,843 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:03:51,843 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:03:51,843 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:03:51,843 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304231843Disabling compacts and flushes for region at 1676304231843Disabling writes for close at 1676304231843Writing region close event to WAL at 1676304231843Closed at 1676304231843 2023-02-13 16:03:51,844 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:51,844 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 16:03:51,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 16:03:51,846 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 16:03:51,847 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 16:03:51,856 INFO [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(952): ClusterId : e36ef470-3c69-47e8-bdb4-7ed2cb9b91fa 2023-02-13 16:03:51,856 INFO [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(952): ClusterId : e36ef470-3c69-47e8-bdb4-7ed2cb9b91fa 2023-02-13 16:03:51,856 DEBUG [RS:0;jenkins-hbase4:45217] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:03:51,856 DEBUG [RS:1;jenkins-hbase4:36263] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:03:51,859 DEBUG [RS:1;jenkins-hbase4:36263] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:03:51,860 DEBUG [RS:1;jenkins-hbase4:36263] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:03:51,859 DEBUG [RS:0;jenkins-hbase4:45217] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:03:51,860 DEBUG [RS:0;jenkins-hbase4:45217] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:03:51,862 DEBUG [RS:1;jenkins-hbase4:36263] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:03:51,863 DEBUG [RS:0;jenkins-hbase4:45217] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:03:51,863 DEBUG [RS:1;jenkins-hbase4:36263] zookeeper.ReadOnlyZKClient(139): Connect 0x4a1b1ef2 to 127.0.0.1:51956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:51,863 DEBUG [RS:0;jenkins-hbase4:45217] zookeeper.ReadOnlyZKClient(139): Connect 0x0f18d01b to 127.0.0.1:51956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:51,872 DEBUG [RS:1;jenkins-hbase4:36263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44dcf9c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:51,873 DEBUG [RS:0;jenkins-hbase4:45217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1df3f88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:51,873 DEBUG [RS:1;jenkins-hbase4:36263] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40e37582, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:51,873 DEBUG [RS:0;jenkins-hbase4:45217] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e0bb6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:51,882 DEBUG [RS:1;jenkins-hbase4:36263] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36263 2023-02-13 16:03:51,882 DEBUG [RS:0;jenkins-hbase4:45217] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45217 2023-02-13 16:03:51,882 INFO [RS:1;jenkins-hbase4:36263] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:03:51,882 INFO [RS:0;jenkins-hbase4:45217] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:03:51,882 INFO [RS:0;jenkins-hbase4:45217] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:03:51,882 INFO [RS:1;jenkins-hbase4:36263] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:03:51,882 DEBUG [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:03:51,882 DEBUG [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:03:51,883 INFO [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41951,1676304231555 with isa=jenkins-hbase4.apache.org/172.31.14.131:45217, startcode=1676304231604 2023-02-13 16:03:51,883 INFO [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,41951,1676304231555 with isa=jenkins-hbase4.apache.org/172.31.14.131:36263, startcode=1676304231635 2023-02-13 16:03:51,883 DEBUG [RS:0;jenkins-hbase4:45217] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:03:51,883 DEBUG [RS:1;jenkins-hbase4:36263] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:03:51,885 INFO [RS-EventLoopGroup-9-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56961, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.4 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:03:51,886 INFO [RS-EventLoopGroup-9-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48125, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.5 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:03:51,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41951] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:51,887 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:51,888 DEBUG [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a 2023-02-13 16:03:51,888 DEBUG [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41017 2023-02-13 16:03:51,888 DEBUG [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:03:51,888 DEBUG [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a 2023-02-13 16:03:51,888 DEBUG [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41017 2023-02-13 16:03:51,888 DEBUG [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:03:51,889 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:51,892 DEBUG [RS:0;jenkins-hbase4:45217] zookeeper.ZKUtil(162): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:51,892 WARN [RS:0;jenkins-hbase4:45217] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:51,892 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36263,1676304231635] 2023-02-13 16:03:51,892 INFO [RS:0;jenkins-hbase4:45217] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:51,892 DEBUG [RS:1;jenkins-hbase4:36263] zookeeper.ZKUtil(162): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:51,892 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45217,1676304231604] 2023-02-13 16:03:51,892 WARN [RS:1;jenkins-hbase4:36263] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:51,892 DEBUG [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/WALs/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:51,892 INFO [RS:1;jenkins-hbase4:36263] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:51,892 DEBUG [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/WALs/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:51,898 DEBUG [RS:0;jenkins-hbase4:45217] zookeeper.ZKUtil(162): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:51,898 DEBUG [RS:1;jenkins-hbase4:36263] zookeeper.ZKUtil(162): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:51,898 DEBUG [RS:0;jenkins-hbase4:45217] zookeeper.ZKUtil(162): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:51,898 DEBUG [RS:1;jenkins-hbase4:36263] zookeeper.ZKUtil(162): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:51,899 DEBUG [RS:0;jenkins-hbase4:45217] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:03:51,899 DEBUG [RS:1;jenkins-hbase4:36263] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:03:51,899 INFO [RS:1;jenkins-hbase4:36263] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:03:51,899 INFO [RS:0;jenkins-hbase4:45217] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:03:51,900 INFO [RS:1;jenkins-hbase4:36263] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:03:51,904 INFO [RS:1;jenkins-hbase4:36263] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:03:51,904 INFO [RS:1;jenkins-hbase4:36263] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,904 INFO [RS:0;jenkins-hbase4:45217] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:03:51,904 INFO [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:03:51,908 INFO [RS:0;jenkins-hbase4:45217] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:03:51,909 INFO [RS:0;jenkins-hbase4:45217] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,909 INFO [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:03:51,910 INFO [RS:1;jenkins-hbase4:36263] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,910 DEBUG [RS:1;jenkins-hbase4:36263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,910 DEBUG [RS:1;jenkins-hbase4:36263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,910 DEBUG [RS:1;jenkins-hbase4:36263] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,910 INFO [RS:0;jenkins-hbase4:45217] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,910 DEBUG [RS:1;jenkins-hbase4:36263] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:0;jenkins-hbase4:45217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:1;jenkins-hbase4:36263] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:0;jenkins-hbase4:45217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:1;jenkins-hbase4:36263] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:51,911 DEBUG [RS:0;jenkins-hbase4:45217] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:1;jenkins-hbase4:36263] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:0;jenkins-hbase4:45217] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:1;jenkins-hbase4:36263] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:0;jenkins-hbase4:45217] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:1;jenkins-hbase4:36263] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:0;jenkins-hbase4:45217] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:51,911 DEBUG [RS:1;jenkins-hbase4:36263] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:0;jenkins-hbase4:45217] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:0;jenkins-hbase4:45217] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:0;jenkins-hbase4:45217] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,911 DEBUG [RS:0;jenkins-hbase4:45217] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:51,915 INFO [RS:1;jenkins-hbase4:36263] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,915 INFO [RS:1;jenkins-hbase4:36263] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,915 INFO [RS:1;jenkins-hbase4:36263] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,915 INFO [RS:0;jenkins-hbase4:45217] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,915 INFO [RS:0;jenkins-hbase4:45217] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,915 INFO [RS:0;jenkins-hbase4:45217] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,926 INFO [RS:1;jenkins-hbase4:36263] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:03:51,926 INFO [RS:1;jenkins-hbase4:36263] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36263,1676304231635-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,931 INFO [RS:0;jenkins-hbase4:45217] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:03:51,931 INFO [RS:0;jenkins-hbase4:45217] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45217,1676304231604-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:51,936 INFO [RS:1;jenkins-hbase4:36263] regionserver.Replication(203): jenkins-hbase4.apache.org,36263,1676304231635 started 2023-02-13 16:03:51,936 INFO [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,36263,1676304231635, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36263, sessionid=0x1004e6c96360002 2023-02-13 16:03:51,937 DEBUG [RS:1;jenkins-hbase4:36263] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:03:51,937 DEBUG [RS:1;jenkins-hbase4:36263] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:51,937 DEBUG [RS:1;jenkins-hbase4:36263] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36263,1676304231635' 2023-02-13 16:03:51,937 DEBUG [RS:1;jenkins-hbase4:36263] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:51,937 DEBUG [RS:1;jenkins-hbase4:36263] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:51,937 DEBUG [RS:1;jenkins-hbase4:36263] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:03:51,937 DEBUG [RS:1;jenkins-hbase4:36263] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:03:51,937 DEBUG [RS:1;jenkins-hbase4:36263] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:51,937 DEBUG [RS:1;jenkins-hbase4:36263] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36263,1676304231635' 2023-02-13 16:03:51,938 DEBUG [RS:1;jenkins-hbase4:36263] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:51,938 DEBUG [RS:1;jenkins-hbase4:36263] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:51,938 DEBUG [RS:1;jenkins-hbase4:36263] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:03:51,938 INFO [RS:1;jenkins-hbase4:36263] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:03:51,938 INFO [RS:1;jenkins-hbase4:36263] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:03:51,942 INFO [RS:0;jenkins-hbase4:45217] regionserver.Replication(203): jenkins-hbase4.apache.org,45217,1676304231604 started 2023-02-13 16:03:51,942 INFO [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45217,1676304231604, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45217, sessionid=0x1004e6c96360001 2023-02-13 16:03:51,942 DEBUG [RS:0;jenkins-hbase4:45217] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:03:51,942 DEBUG [RS:0;jenkins-hbase4:45217] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:51,942 DEBUG [RS:0;jenkins-hbase4:45217] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45217,1676304231604' 2023-02-13 16:03:51,942 DEBUG [RS:0;jenkins-hbase4:45217] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:51,943 DEBUG [RS:0;jenkins-hbase4:45217] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:51,943 DEBUG [RS:0;jenkins-hbase4:45217] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:03:51,943 DEBUG [RS:0;jenkins-hbase4:45217] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:03:51,943 DEBUG [RS:0;jenkins-hbase4:45217] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:51,943 DEBUG [RS:0;jenkins-hbase4:45217] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45217,1676304231604' 2023-02-13 16:03:51,943 DEBUG [RS:0;jenkins-hbase4:45217] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:51,943 DEBUG [RS:0;jenkins-hbase4:45217] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:51,943 DEBUG [RS:0;jenkins-hbase4:45217] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:03:51,944 INFO [RS:0;jenkins-hbase4:45217] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:03:51,944 INFO [RS:0;jenkins-hbase4:45217] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:03:51,997 DEBUG [jenkins-hbase4:41951] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 16:03:51,997 DEBUG [jenkins-hbase4:41951] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:51,999 DEBUG [jenkins-hbase4:41951] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:51,999 DEBUG [jenkins-hbase4:41951] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:51,999 DEBUG [jenkins-hbase4:41951] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:52,000 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36263,1676304231635, state=OPENING 2023-02-13 16:03:52,001 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 16:03:52,002 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:52,003 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:03:52,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36263,1676304231635}] 2023-02-13 16:03:52,157 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:52,157 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:03:52,159 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44458, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:03:52,163 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 16:03:52,163 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:52,165 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36263%2C1676304231635.meta, suffix=.meta, logDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/WALs/jenkins-hbase4.apache.org,36263,1676304231635, archiveDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/oldWALs, maxLogs=32 2023-02-13 16:03:52,180 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38105,DS-41d69a91-ea47-4273-ae99-647a452bae12,DISK] 2023-02-13 16:03:52,180 DEBUG [RS-EventLoopGroup-11-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38233,DS-d45fb72f-a73b-44d3-b692-ba98338cfcad,DISK] 2023-02-13 16:03:52,182 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/WALs/jenkins-hbase4.apache.org,36263,1676304231635/jenkins-hbase4.apache.org%2C36263%2C1676304231635.meta.1676304232165.meta 2023-02-13 16:03:52,183 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38105,DS-41d69a91-ea47-4273-ae99-647a452bae12,DISK], DatanodeInfoWithStorage[127.0.0.1:38233,DS-d45fb72f-a73b-44d3-b692-ba98338cfcad,DISK]] 2023-02-13 16:03:52,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:52,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 16:03:52,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 16:03:52,184 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 16:03:52,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 16:03:52,184 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:52,185 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 16:03:52,185 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 16:03:52,188 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:03:52,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/info 2023-02-13 16:03:52,189 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/info 2023-02-13 16:03:52,189 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:03:52,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:52,190 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:03:52,191 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:52,191 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:52,191 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:03:52,192 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:52,192 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:03:52,193 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/table 2023-02-13 16:03:52,193 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/table 2023-02-13 16:03:52,193 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:03:52,193 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:52,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740 2023-02-13 16:03:52,195 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740 2023-02-13 16:03:52,197 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:03:52,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:03:52,198 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61823877, jitterRate=-0.07875244319438934}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:03:52,199 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676304232185Writing region info on filesystem at 1676304232185Initializing all the Stores at 1676304232186 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304232186Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304232188 (+2 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304232188Cleaning up temporary data from old regions at 1676304232196 (+8 ms)Cleaning up detritus from prior splits at 1676304232196Running coprocessor post-open hooks at 1676304232199 (+3 ms)Region opened successfully at 1676304232199 2023-02-13 16:03:52,199 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676304232157 2023-02-13 16:03:52,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 16:03:52,204 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 16:03:52,204 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36263,1676304231635, state=OPEN 2023-02-13 16:03:52,206 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 16:03:52,206 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:03:52,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 16:03:52,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36263,1676304231635 in 203 msec 2023-02-13 16:03:52,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 16:03:52,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 364 msec 2023-02-13 16:03:52,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 413 msec 2023-02-13 16:03:52,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676304231657, completionTime=-1 2023-02-13 16:03:52,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 16:03:52,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 16:03:52,216 DEBUG [hconnection-0x31ae5f35-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:52,217 INFO [RS-EventLoopGroup-11-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44474, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:52,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 16:03:52,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676304292219 2023-02-13 16:03:52,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676304352219 2023-02-13 16:03:52,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 7 msec 2023-02-13 16:03:52,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41951,1676304231555-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:52,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41951,1676304231555-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:52,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41951,1676304231555-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:52,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41951, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:52,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:52,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 16:03:52,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:52,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 16:03:52,228 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 16:03:52,228 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:03:52,229 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:03:52,230 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:52,231 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b empty. 2023-02-13 16:03:52,231 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:52,231 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 16:03:52,240 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:52,241 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 718fc4c0fcda0a7abfc8aadc3c4e811b, NAME => 'hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp 2023-02-13 16:03:52,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:52,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 718fc4c0fcda0a7abfc8aadc3c4e811b, disabling compactions & flushes 2023-02-13 16:03:52,250 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:52,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:52,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. after waiting 0 ms 2023-02-13 16:03:52,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:52,250 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:52,250 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 718fc4c0fcda0a7abfc8aadc3c4e811b: Waiting for close lock at 1676304232250Disabling compacts and flushes for region at 1676304232250Disabling writes for close at 1676304232250Writing region close event to WAL at 1676304232250Closed at 1676304232250 2023-02-13 16:03:52,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:03:52,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304232253"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304232253"}]},"ts":"1676304232253"} 2023-02-13 16:03:52,255 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:03:52,256 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:03:52,256 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304232256"}]},"ts":"1676304232256"} 2023-02-13 16:03:52,257 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 16:03:52,261 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:52,262 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:52,262 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:52,262 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:52,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=718fc4c0fcda0a7abfc8aadc3c4e811b, ASSIGN}] 2023-02-13 16:03:52,265 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=718fc4c0fcda0a7abfc8aadc3c4e811b, ASSIGN 2023-02-13 16:03:52,265 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=718fc4c0fcda0a7abfc8aadc3c4e811b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45217,1676304231604; forceNewPlan=false, retain=false 2023-02-13 16:03:52,416 INFO [jenkins-hbase4:41951] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:03:52,417 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=718fc4c0fcda0a7abfc8aadc3c4e811b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:52,417 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304232417"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304232417"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304232417"}]},"ts":"1676304232417"} 2023-02-13 16:03:52,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 718fc4c0fcda0a7abfc8aadc3c4e811b, server=jenkins-hbase4.apache.org,45217,1676304231604}] 2023-02-13 16:03:52,571 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:52,572 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:03:52,573 INFO [RS-EventLoopGroup-10-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:03:52,578 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:52,579 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45217%2C1676304231604, suffix=, logDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/WALs/jenkins-hbase4.apache.org,45217,1676304231604, archiveDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/oldWALs, maxLogs=32 2023-02-13 16:03:52,594 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38233,DS-d45fb72f-a73b-44d3-b692-ba98338cfcad,DISK] 2023-02-13 16:03:52,594 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38105,DS-41d69a91-ea47-4273-ae99-647a452bae12,DISK] 2023-02-13 16:03:52,596 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/WALs/jenkins-hbase4.apache.org,45217,1676304231604/jenkins-hbase4.apache.org%2C45217%2C1676304231604.1676304232580 2023-02-13 16:03:52,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38105,DS-41d69a91-ea47-4273-ae99-647a452bae12,DISK], DatanodeInfoWithStorage[127.0.0.1:38233,DS-d45fb72f-a73b-44d3-b692-ba98338cfcad,DISK]] 2023-02-13 16:03:52,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 718fc4c0fcda0a7abfc8aadc3c4e811b, NAME => 'hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:52,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:52,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:52,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:52,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:52,598 INFO [StoreOpener-718fc4c0fcda0a7abfc8aadc3c4e811b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:52,599 DEBUG [StoreOpener-718fc4c0fcda0a7abfc8aadc3c4e811b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b/info 2023-02-13 16:03:52,599 DEBUG [StoreOpener-718fc4c0fcda0a7abfc8aadc3c4e811b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b/info 2023-02-13 16:03:52,600 INFO [StoreOpener-718fc4c0fcda0a7abfc8aadc3c4e811b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 718fc4c0fcda0a7abfc8aadc3c4e811b columnFamilyName info 2023-02-13 16:03:52,600 INFO [StoreOpener-718fc4c0fcda0a7abfc8aadc3c4e811b-1] regionserver.HStore(310): Store=718fc4c0fcda0a7abfc8aadc3c4e811b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:52,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:52,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:52,603 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:52,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:52,605 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 718fc4c0fcda0a7abfc8aadc3c4e811b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60901941, jitterRate=-0.09249036014080048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:03:52,606 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 718fc4c0fcda0a7abfc8aadc3c4e811b: Running coprocessor pre-open hook at 1676304232597Writing region info on filesystem at 1676304232597Initializing all the Stores at 1676304232598 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304232598Cleaning up temporary data from old regions at 1676304232602 (+4 ms)Cleaning up detritus from prior splits at 1676304232602Running coprocessor post-open hooks at 1676304232606 (+4 ms)Region opened successfully at 1676304232606 2023-02-13 16:03:52,606 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b., pid=6, masterSystemTime=1676304232571 2023-02-13 16:03:52,609 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:52,610 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:52,610 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=718fc4c0fcda0a7abfc8aadc3c4e811b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:52,610 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304232610"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304232610"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304232610"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304232610"}]},"ts":"1676304232610"} 2023-02-13 16:03:52,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 16:03:52,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 718fc4c0fcda0a7abfc8aadc3c4e811b, server=jenkins-hbase4.apache.org,45217,1676304231604 in 193 msec 2023-02-13 16:03:52,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 16:03:52,615 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=718fc4c0fcda0a7abfc8aadc3c4e811b, ASSIGN in 351 msec 2023-02-13 16:03:52,615 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:03:52,615 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304232615"}]},"ts":"1676304232615"} 2023-02-13 16:03:52,617 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 16:03:52,619 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:03:52,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 393 msec 2023-02-13 16:03:52,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 16:03:52,629 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:52,629 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:52,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:52,633 INFO [RS-EventLoopGroup-10-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:52,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 16:03:52,647 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:52,650 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 15 msec 2023-02-13 16:03:52,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 16:03:52,662 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:52,665 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-13 16:03:52,670 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 16:03:52,672 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 16:03:52,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.010sec 2023-02-13 16:03:52,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 16:03:52,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 16:03:52,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 16:03:52,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41951,1676304231555-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 16:03:52,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41951,1676304231555-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 16:03:52,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 16:03:52,757 DEBUG [Listener at localhost/34983] zookeeper.ReadOnlyZKClient(139): Connect 0x3c94fbf3 to 127.0.0.1:51956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:52,762 DEBUG [Listener at localhost/34983] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62a707c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:52,763 DEBUG [hconnection-0x52be757e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:52,765 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44482, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:52,766 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41951,1676304231555 2023-02-13 16:03:52,766 DEBUG [Listener at localhost/34983] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 16:03:52,768 DEBUG [Listener at localhost/34983] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 16:03:52,770 INFO [RS-EventLoopGroup-9-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52734, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 16:03:52,770 INFO [Listener at localhost/34983] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:52,771 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:52,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 16:03:52,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 96 connection: 172.31.14.131:52734 deadline: 1676304292771, exception=org.apache.hadoop.hbase.TableNotFoundException: testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:52,771 INFO [Listener at localhost/34983] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testInitTableSnapshotMapperJobConfig' 2023-02-13 16:03:52,774 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:52,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:52,776 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:03:52,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testInitTableSnapshotMapperJobConfig" procId is: 10 2023-02-13 16:03:52,777 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:03:52,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:52,778 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:52,779 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3 empty. 2023-02-13 16:03:52,779 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:52,779 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-13 16:03:52,789 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:52,790 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(7671): creating {ENCODED => aaa328fdf624aa5c6b4cb3ce9abda7d3, NAME => 'testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp 2023-02-13 16:03:52,800 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:52,800 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1603): Closing aaa328fdf624aa5c6b4cb3ce9abda7d3, disabling compactions & flushes 2023-02-13 16:03:52,800 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:52,800 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:52,800 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. after waiting 0 ms 2023-02-13 16:03:52,800 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:52,800 INFO [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:52,800 DEBUG [RegionOpenAndInit-testInitTableSnapshotMapperJobConfig-pool-0] regionserver.HRegion(1557): Region close journal for aaa328fdf624aa5c6b4cb3ce9abda7d3: Waiting for close lock at 1676304232800Disabling compacts and flushes for region at 1676304232800Disabling writes for close at 1676304232800Writing region close event to WAL at 1676304232800Closed at 1676304232800 2023-02-13 16:03:52,803 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:03:52,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676304232803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304232803"}]},"ts":"1676304232803"} 2023-02-13 16:03:52,805 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:03:52,806 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:03:52,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304232806"}]},"ts":"1676304232806"} 2023-02-13 16:03:52,807 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLING in hbase:meta 2023-02-13 16:03:52,812 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:52,813 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:52,813 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:52,813 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:52,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aaa328fdf624aa5c6b4cb3ce9abda7d3, ASSIGN}] 2023-02-13 16:03:52,815 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aaa328fdf624aa5c6b4cb3ce9abda7d3, ASSIGN 2023-02-13 16:03:52,815 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aaa328fdf624aa5c6b4cb3ce9abda7d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45217,1676304231604; forceNewPlan=false, retain=false 2023-02-13 16:03:52,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:52,939 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 16:03:52,941 INFO [RS:1;jenkins-hbase4:36263] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36263%2C1676304231635, suffix=, logDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/WALs/jenkins-hbase4.apache.org,36263,1676304231635, archiveDir=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/oldWALs, maxLogs=32 2023-02-13 16:03:52,966 INFO [jenkins-hbase4:41951] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:03:52,966 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aaa328fdf624aa5c6b4cb3ce9abda7d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:52,967 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676304232966"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304232966"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304232966"}]},"ts":"1676304232966"} 2023-02-13 16:03:52,968 DEBUG [RS-EventLoopGroup-11-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38233,DS-d45fb72f-a73b-44d3-b692-ba98338cfcad,DISK] 2023-02-13 16:03:52,969 DEBUG [RS-EventLoopGroup-11-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38105,DS-41d69a91-ea47-4273-ae99-647a452bae12,DISK] 2023-02-13 16:03:52,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure aaa328fdf624aa5c6b4cb3ce9abda7d3, server=jenkins-hbase4.apache.org,45217,1676304231604}] 2023-02-13 16:03:52,972 INFO [RS:1;jenkins-hbase4:36263] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/WALs/jenkins-hbase4.apache.org,36263,1676304231635/jenkins-hbase4.apache.org%2C36263%2C1676304231635.1676304232943 2023-02-13 16:03:52,975 DEBUG [RS:1;jenkins-hbase4:36263] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38233,DS-d45fb72f-a73b-44d3-b692-ba98338cfcad,DISK], DatanodeInfoWithStorage[127.0.0.1:38105,DS-41d69a91-ea47-4273-ae99-647a452bae12,DISK]] 2023-02-13 16:03:53,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:53,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:53,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => aaa328fdf624aa5c6b4cb3ce9abda7d3, NAME => 'testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:53,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testInitTableSnapshotMapperJobConfig aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:53,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:53,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:53,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:53,128 INFO [StoreOpener-aaa328fdf624aa5c6b4cb3ce9abda7d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:53,129 DEBUG [StoreOpener-aaa328fdf624aa5c6b4cb3ce9abda7d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1 2023-02-13 16:03:53,129 DEBUG [StoreOpener-aaa328fdf624aa5c6b4cb3ce9abda7d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1 2023-02-13 16:03:53,129 INFO [StoreOpener-aaa328fdf624aa5c6b4cb3ce9abda7d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aaa328fdf624aa5c6b4cb3ce9abda7d3 columnFamilyName f1 2023-02-13 16:03:53,130 INFO [StoreOpener-aaa328fdf624aa5c6b4cb3ce9abda7d3-1] regionserver.HStore(310): Store=aaa328fdf624aa5c6b4cb3ce9abda7d3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:53,130 INFO [StoreOpener-aaa328fdf624aa5c6b4cb3ce9abda7d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:53,131 DEBUG [StoreOpener-aaa328fdf624aa5c6b4cb3ce9abda7d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2 2023-02-13 16:03:53,131 DEBUG [StoreOpener-aaa328fdf624aa5c6b4cb3ce9abda7d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2 2023-02-13 16:03:53,131 INFO [StoreOpener-aaa328fdf624aa5c6b4cb3ce9abda7d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aaa328fdf624aa5c6b4cb3ce9abda7d3 columnFamilyName f2 2023-02-13 16:03:53,131 INFO [StoreOpener-aaa328fdf624aa5c6b4cb3ce9abda7d3-1] regionserver.HStore(310): Store=aaa328fdf624aa5c6b4cb3ce9abda7d3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:53,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:53,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:53,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testInitTableSnapshotMapperJobConfig descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:53,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:53,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:53,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened aaa328fdf624aa5c6b4cb3ce9abda7d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72036406, jitterRate=0.07342609763145447}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:53,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for aaa328fdf624aa5c6b4cb3ce9abda7d3: Running coprocessor pre-open hook at 1676304233127Writing region info on filesystem at 1676304233127Initializing all the Stores at 1676304233127Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304233128 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304233128Cleaning up temporary data from old regions at 1676304233133 (+5 ms)Cleaning up detritus from prior splits at 1676304233133Running coprocessor post-open hooks at 1676304233141 (+8 ms)Region opened successfully at 1676304233141 2023-02-13 16:03:53,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3., pid=12, masterSystemTime=1676304233123 2023-02-13 16:03:53,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:53,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:53,143 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=aaa328fdf624aa5c6b4cb3ce9abda7d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,144 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676304233143"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304233143"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304233143"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304233143"}]},"ts":"1676304233143"} 2023-02-13 16:03:53,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 16:03:53,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure aaa328fdf624aa5c6b4cb3ce9abda7d3, server=jenkins-hbase4.apache.org,45217,1676304231604 in 174 msec 2023-02-13 16:03:53,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 16:03:53,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aaa328fdf624aa5c6b4cb3ce9abda7d3, ASSIGN in 334 msec 2023-02-13 16:03:53,149 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:03:53,149 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304233149"}]},"ts":"1676304233149"} 2023-02-13 16:03:53,150 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=ENABLED in hbase:meta 2023-02-13 16:03:53,152 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:03:53,153 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testInitTableSnapshotMapperJobConfig in 378 msec 2023-02-13 16:03:53,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:53,383 INFO [Listener at localhost/34983] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 10 completed 2023-02-13 16:03:53,383 DEBUG [Listener at localhost/34983] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testInitTableSnapshotMapperJobConfig get assigned. Timeout = 60000ms 2023-02-13 16:03:53,383 INFO [Listener at localhost/34983] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:03:53,398 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(3484): All regions for table testInitTableSnapshotMapperJobConfig assigned to meta. Checking AM states. 2023-02-13 16:03:53,399 INFO [Listener at localhost/34983] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:03:53,399 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(3504): All regions for table testInitTableSnapshotMapperJobConfig assigned. 2023-02-13 16:03:53,399 INFO [Listener at localhost/34983] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 16:03:53,426 DEBUG [hconnection-0x52be757e-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:53,441 INFO [RS-EventLoopGroup-10-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51230, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:53,454 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45217] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:53,578 INFO [Listener at localhost/34983] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 16:03:53,578 INFO [Listener at localhost/34983] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 16:03:53,580 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 16:03:53,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676304233580 (current time:1676304233580). 2023-02-13 16:03:53,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 16:03:53,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] zookeeper.ReadOnlyZKClient(139): Connect 0x2acedde2 to 127.0.0.1:51956 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:53,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@197b5dce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:53,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:53,588 INFO [RS-EventLoopGroup-11-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50722, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:53,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2acedde2 to 127.0.0.1:51956 2023-02-13 16:03:53,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:53,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 16:03:53,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 16:03:53,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 16:03:53,593 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 16:03:53,594 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE; timeout=600000, timestamp=1676304833594 2023-02-13 16:03:53,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } 2023-02-13 16:03:53,594 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:53,595 DEBUG [Listener at localhost/34983] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 16:03:53,595 DEBUG [Listener at localhost/34983] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 16:03:53,596 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE 2023-02-13 16:03:53,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 16:03:53,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=EXCLUSIVE in 5 msec 2023-02-13 16:03:53,598 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 16:03:53,598 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED; timeout=600000, timestamp=1676304833598 2023-02-13 16:03:53,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-13 16:03:53,610 INFO [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-13 16:03:53,610 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:53,611 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-13 16:03:53,611 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-13 16:03:53,612 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,612 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-13 16:03:53,613 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:53,613 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:53,613 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:53,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:53,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:53,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:53,614 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,614 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:03:53,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 16:03:53,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 16:03:53,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,614 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-13 16:03:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 60 2023-02-13 16:03:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 16:03:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 16:03:53,615 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-13 16:03:53,615 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testInitTableSnapshotMapperJobConfig type FLUSH 2023-02-13 16:03:53,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 16:03:53,615 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 16:03:53,615 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 16:03:53,615 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 16:03:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 16:03:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 16:03:53,616 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36263,1676304231635' joining acquired barrier for procedure (foo) in zk 2023-02-13 16:03:53,617 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 16:03:53,617 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 16:03:53,617 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45217,1676304231604' joining acquired barrier for procedure (foo) in zk 2023-02-13 16:03:53,618 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,619 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,619 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:53,619 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,619 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:53,620 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,620 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:03:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:53,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45217,1676304231604' joining acquired barrier for procedure 'foo' on coordinator 2023-02-13 16:03:53,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fcbb28[Count = 0] remaining members to acquire global barrier 2023-02-13 16:03:53,622 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-13 16:03:53,622 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,624 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,624 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,624 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 16:03:53,624 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,625 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:03:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 16:03:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 16:03:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 16:03:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,36263,1676304231635' in zk 2023-02-13 16:03:53,625 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 16:03:53,625 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:53,625 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. started... 2023-02-13 16:03:53,626 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] regionserver.HRegion(2744): Flushing aaa328fdf624aa5c6b4cb3ce9abda7d3 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 16:03:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 16:03:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:53,627 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 16:03:53,655 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/.tmp/f1/c5fc2a2a82f74cffa1bfd026c9b7577c 2023-02-13 16:03:53,684 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/.tmp/f2/0298fe4da21149dca09bfc2cc31fa693 2023-02-13 16:03:53,690 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/.tmp/f1/c5fc2a2a82f74cffa1bfd026c9b7577c as hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1/c5fc2a2a82f74cffa1bfd026c9b7577c 2023-02-13 16:03:53,695 DEBUG [Listener at localhost/34983] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:53,698 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1/c5fc2a2a82f74cffa1bfd026c9b7577c, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 16:03:53,698 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/.tmp/f2/0298fe4da21149dca09bfc2cc31fa693 as hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2/0298fe4da21149dca09bfc2cc31fa693 2023-02-13 16:03:53,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-13 16:03:53,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:53,701 DEBUG [Listener at localhost/34983] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 16:03:53,705 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2/0298fe4da21149dca09bfc2cc31fa693, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 16:03:53,708 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for aaa328fdf624aa5c6b4cb3ce9abda7d3 in 82ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:53,708 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testInitTableSnapshotMapperJobConfig' 2023-02-13 16:03:53,709 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for aaa328fdf624aa5c6b4cb3ce9abda7d3: 2023-02-13 16:03:53,709 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.' region-info for snapshot=foo 2023-02-13 16:03:53,709 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:53,709 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1/c5fc2a2a82f74cffa1bfd026c9b7577c] hfiles 2023-02-13 16:03:53,709 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1/c5fc2a2a82f74cffa1bfd026c9b7577c for snapshot=foo 2023-02-13 16:03:53,709 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2/0298fe4da21149dca09bfc2cc31fa693] hfiles 2023-02-13 16:03:53,709 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2/0298fe4da21149dca09bfc2cc31fa693 for snapshot=foo 2023-02-13 16:03:53,717 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. completed. 2023-02-13 16:03:53,717 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:53,717 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 16:03:53,717 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 16:03:53,717 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,717 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 16:03:53,717 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,45217,1676304231604' in zk 2023-02-13 16:03:53,719 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,719 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 16:03:53,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:53,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:53,719 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:53,720 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 16:03:53,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:53,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:53,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:03:53,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:53,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:53,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:03:53,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:53,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,45217,1676304231604': 2023-02-13 16:03:53,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45217,1676304231604' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-13 16:03:53,725 INFO [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-13 16:03:53,725 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:03:53,725 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:03:53,725 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-13 16:03:53,725 INFO [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 16:03:53,727 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,727 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:53,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,727 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,727 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:53,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:53,727 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:53,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:53,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:53,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:53,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:53,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:53,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,728 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:53,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:03:53,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,729 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:53,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:03:53,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:53,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:53,731 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:03:53,731 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:53,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,739 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,739 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:53,739 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:53,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:53,739 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:53,739 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 16:03:53,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:53,739 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:53,739 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:53,739 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:53,739 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-13 16:03:53,739 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 16:03:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:53,741 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:53,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-13 16:03:53,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:53,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:53,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:53,741 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,742 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:53,742 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 16:03:53,742 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 16:03:53,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.hbase-snapshot/.tmp/foo 2023-02-13 16:03:53,760 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.hbase-snapshot/.tmp/foo to hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.hbase-snapshot/foo 2023-02-13 16:03:53,780 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testInitTableSnapshotMapperJobConfig completed 2023-02-13 16:03:53,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.hbase-snapshot/.tmp/foo 2023-02-13 16:03:53,781 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.hbase-snapshot/.tmp/foo 2023-02-13 16:03:53,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testInitTableSnapshotMapperJobConfig at 1676304233594Consolidate snapshot: foo at 1676304233741 (+147 ms)Loading Region manifests for foo at 1676304233741Writing data manifest for foo at 1676304233745 (+4 ms)Verifying snapshot: foo at 1676304233753 (+8 ms)Snapshot foo of table testInitTableSnapshotMapperJobConfig completed at 1676304233780 (+27 ms) 2023-02-13 16:03:53,783 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED 2023-02-13 16:03:53,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testInitTableSnapshotMapperJobConfig, type=SHARED in 188 msec 2023-02-13 16:03:53,901 DEBUG [Listener at localhost/34983] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:53,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 } is done 2023-02-13 16:03:53,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testInitTableSnapshotMapperJobConfig type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 16:03:53,903 INFO [Listener at localhost/34983] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 16:03:53,907 INFO [Listener at localhost/34983] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 16:03:53,912 INFO [Listener at localhost/34983] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 16:03:53,961 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45217] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,075 INFO [Listener at localhost/34983] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 16:03:54,081 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 16:03:54,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] procedure.ProcedureCoordinator(165): Submitting procedure testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,084 INFO [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testInitTableSnapshotMapperJobConfig' 2023-02-13 16:03:54,084 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:54,085 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' 2023-02-13 16:03:54,085 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testInitTableSnapshotMapperJobConfig', kicking off acquire phase on members. 2023-02-13 16:03:54,085 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,085 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,087 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,087 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:54,087 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:54,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:54,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:54,087 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,087 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:03:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:03:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,088 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:03:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,089 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,089 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-13 16:03:54,089 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-13 16:03:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-13 16:03:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36263,1676304231635' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-13 16:03:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testInitTableSnapshotMapperJobConfig' with timeout 60000ms 2023-02-13 16:03:54,090 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:54,091 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testInitTableSnapshotMapperJobConfig' starting 'acquire' stage 2023-02-13 16:03:54,091 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 16:03:54,091 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 16:03:54,091 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,091 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. started... 2023-02-13 16:03:54,091 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing aaa328fdf624aa5c6b4cb3ce9abda7d3 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 16:03:54,093 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,093 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,093 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:54,110 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/.tmp/f1/022a8e8185c74373b68fa045a32c5fcc 2023-02-13 16:03:54,137 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/.tmp/f2/f755034053694d84bf588185993442df 2023-02-13 16:03:54,142 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/.tmp/f1/022a8e8185c74373b68fa045a32c5fcc as hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1/022a8e8185c74373b68fa045a32c5fcc 2023-02-13 16:03:54,147 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1/022a8e8185c74373b68fa045a32c5fcc, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 16:03:54,148 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/.tmp/f2/f755034053694d84bf588185993442df as hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2/f755034053694d84bf588185993442df 2023-02-13 16:03:54,152 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2/f755034053694d84bf588185993442df, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 16:03:54,153 INFO [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for aaa328fdf624aa5c6b4cb3ce9abda7d3 in 62ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:54,154 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for aaa328fdf624aa5c6b4cb3ce9abda7d3: 2023-02-13 16:03:54,154 DEBUG [rs(jenkins-hbase4.apache.org,45217,1676304231604)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,154 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 16:03:54,154 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 16:03:54,154 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,154 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally acquired 2023-02-13 16:03:54,154 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45217,1676304231604' joining acquired barrier for procedure (testInitTableSnapshotMapperJobConfig) in zk 2023-02-13 16:03:54,157 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,157 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:54,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:54,157 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,157 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testInitTableSnapshotMapperJobConfig' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:54,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:54,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:54,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:54,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45217,1676304231604' joining acquired barrier for procedure 'testInitTableSnapshotMapperJobConfig' on coordinator 2023-02-13 16:03:54,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c33f0f[Count = 0] remaining members to acquire global barrier 2023-02-13 16:03:54,159 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testInitTableSnapshotMapperJobConfig' starting 'in-barrier' execution. 2023-02-13 16:03:54,159 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,160 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,160 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,160 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-13 16:03:54,160 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,160 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:03:54,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,160 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-13 16:03:54,160 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,36263,1676304231635' in zk 2023-02-13 16:03:54,160 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testInitTableSnapshotMapperJobConfig' received 'reached' from coordinator. 2023-02-13 16:03:54,161 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testInitTableSnapshotMapperJobConfig' locally completed 2023-02-13 16:03:54,161 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testInitTableSnapshotMapperJobConfig' completed for member 'jenkins-hbase4.apache.org,45217,1676304231604' in zk 2023-02-13 16:03:54,162 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-13 16:03:54,162 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:54,162 DEBUG [member: 'jenkins-hbase4.apache.org,36263,1676304231635' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-13 16:03:54,163 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,163 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testInitTableSnapshotMapperJobConfig' has notified controller of completion 2023-02-13 16:03:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:54,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:54,163 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:54,163 DEBUG [member: 'jenkins-hbase4.apache.org,45217,1676304231604' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testInitTableSnapshotMapperJobConfig' completed. 2023-02-13 16:03:54,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:54,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:54,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testInitTableSnapshotMapperJobConfig' member 'jenkins-hbase4.apache.org,45217,1676304231604': 2023-02-13 16:03:54,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45217,1676304231604' released barrier for procedure'testInitTableSnapshotMapperJobConfig', counting down latch. Waiting for 0 more 2023-02-13 16:03:54,167 INFO [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testInitTableSnapshotMapperJobConfig' execution completed 2023-02-13 16:03:54,167 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:03:54,167 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:03:54,167 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,167 INFO [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testInitTableSnapshotMapperJobConfigincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 16:03:54,169 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,169 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:54,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:54,169 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,169 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:54,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:54,169 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:54,170 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:54,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:54,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:54,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:54,170 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:54,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,172 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:54,172 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,175 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:54,175 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:54,175 DEBUG [(jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:54,175 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:54,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:54,175 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testInitTableSnapshotMapperJobConfig' 2023-02-13 16:03:54,176 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 16:03:54,175 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,175 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:54,176 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,176 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:03:54,176 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,176 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,176 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,176 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,176 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,176 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:54,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:54,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:54,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:54,176 DEBUG [Listener at localhost/34983] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testInitTableSnapshotMapperJobConfig'' to complete. (max 20000 ms per retry) 2023-02-13 16:03:54,176 DEBUG [Listener at localhost/34983] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 16:03:54,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:03:54,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:54,276 DEBUG [Listener at localhost/34983] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 16:03:54,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 16:03:54,283 INFO [Listener at localhost/34983] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676304233580 type: FLUSH version: 2 ttl: 0 2023-02-13 16:03:54,283 DEBUG [Listener at localhost/34983] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41017/user/jenkins/test-data/c7595805-ca29-d3e4-1aa6-93297ccc5994/foo/ad4928fe-6c62-4382-bbb1-e751c9e04b50/data/default/testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,284 INFO [Listener at localhost/34983] snapshot.RestoreSnapshotHelper(239): region to add: aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:54,284 INFO [Listener at localhost/34983] snapshot.RestoreSnapshotHelper(585): clone region=aaa328fdf624aa5c6b4cb3ce9abda7d3 as aaa328fdf624aa5c6b4cb3ce9abda7d3 in snapshot foo 2023-02-13 16:03:54,285 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => aaa328fdf624aa5c6b4cb3ce9abda7d3, NAME => 'testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testInitTableSnapshotMapperJobConfig', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41017/user/jenkins/test-data/c7595805-ca29-d3e4-1aa6-93297ccc5994/foo/ad4928fe-6c62-4382-bbb1-e751c9e04b50 2023-02-13 16:03:54,292 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:54,292 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c5fc2a2a82f74cffa1bfd026c9b7577c from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,294 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0298fe4da21149dca09bfc2cc31fa693 from cloned region in snapshot foo to table=testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,296 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing aaa328fdf624aa5c6b4cb3ce9abda7d3, disabling compactions & flushes 2023-02-13 16:03:54,296 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,296 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,296 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. after waiting 0 ms 2023-02-13 16:03:54,296 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,296 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,296 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for aaa328fdf624aa5c6b4cb3ce9abda7d3: Waiting for close lock at 1676304234296Disabling compacts and flushes for region at 1676304234296Disabling writes for close at 1676304234296Writing region close event to WAL at 1676304234296Closed at 1676304234296 2023-02-13 16:03:54,296 INFO [Listener at localhost/34983] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testInitTableSnapshotMapperJobConfig" creation_time: 1676304233580 type: FLUSH version: 2 ttl: 0 2023-02-13 16:03:54,297 DEBUG [Listener at localhost/34983] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41017/user/jenkins/test-data/c7595805-ca29-d3e4-1aa6-93297ccc5994/foo/ad4928fe-6c62-4382-bbb1-e751c9e04b50 2023-02-13 16:03:54,297 DEBUG [Listener at localhost/34983] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41017/user/jenkins/test-data/c7595805-ca29-d3e4-1aa6-93297ccc5994/foo/ad4928fe-6c62-4382-bbb1-e751c9e04b50 2023-02-13 16:03:54,297 DEBUG [Listener at localhost/34983] util.CommonFSUtils(699): |-data/ 2023-02-13 16:03:54,298 DEBUG [Listener at localhost/34983] util.CommonFSUtils(699): |----default/ 2023-02-13 16:03:54,298 DEBUG [Listener at localhost/34983] util.CommonFSUtils(699): |-------testInitTableSnapshotMapperJobConfig/ 2023-02-13 16:03:54,299 DEBUG [Listener at localhost/34983] util.CommonFSUtils(699): |----------aaa328fdf624aa5c6b4cb3ce9abda7d3/ 2023-02-13 16:03:54,299 DEBUG [Listener at localhost/34983] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:03:54,299 DEBUG [Listener at localhost/34983] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:03:54,300 DEBUG [Listener at localhost/34983] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=aaa328fdf624aa5c6b4cb3ce9abda7d3-c5fc2a2a82f74cffa1bfd026c9b7577c 2023-02-13 16:03:54,300 DEBUG [Listener at localhost/34983] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:03:54,300 DEBUG [Listener at localhost/34983] util.CommonFSUtils(702): |----------------testInitTableSnapshotMapperJobConfig=aaa328fdf624aa5c6b4cb3ce9abda7d3-0298fe4da21149dca09bfc2cc31fa693 2023-02-13 16:03:54,302 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-13 16:03:54,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-13 16:03:54,305 INFO [Listener at localhost/34983] client.HBaseAdmin$15(890): Started disable of testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,306 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,309 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304234309"}]},"ts":"1676304234309"} 2023-02-13 16:03:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:03:54,311 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLING in hbase:meta 2023-02-13 16:03:54,312 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testInitTableSnapshotMapperJobConfig to state=DISABLING 2023-02-13 16:03:54,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aaa328fdf624aa5c6b4cb3ce9abda7d3, UNASSIGN}] 2023-02-13 16:03:54,314 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aaa328fdf624aa5c6b4cb3ce9abda7d3, UNASSIGN 2023-02-13 16:03:54,315 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aaa328fdf624aa5c6b4cb3ce9abda7d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,315 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676304234315"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304234315"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304234315"}]},"ts":"1676304234315"} 2023-02-13 16:03:54,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure aaa328fdf624aa5c6b4cb3ce9abda7d3, server=jenkins-hbase4.apache.org,45217,1676304231604}] 2023-02-13 16:03:54,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:03:54,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:54,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing aaa328fdf624aa5c6b4cb3ce9abda7d3, disabling compactions & flushes 2023-02-13 16:03:54,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. after waiting 0 ms 2023-02-13 16:03:54,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:03:54,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3. 2023-02-13 16:03:54,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for aaa328fdf624aa5c6b4cb3ce9abda7d3: Waiting for close lock at 1676304234468Running coprocessor pre-close hooks at 1676304234468Disabling compacts and flushes for region at 1676304234468Disabling writes for close at 1676304234468Writing region close event to WAL at 1676304234469 (+1 ms)Running coprocessor post-close hooks at 1676304234473 (+4 ms)Closed at 1676304234473 2023-02-13 16:03:54,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:54,475 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=aaa328fdf624aa5c6b4cb3ce9abda7d3, regionState=CLOSED 2023-02-13 16:03:54,475 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676304234475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304234475"}]},"ts":"1676304234475"} 2023-02-13 16:03:54,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 16:03:54,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure aaa328fdf624aa5c6b4cb3ce9abda7d3, server=jenkins-hbase4.apache.org,45217,1676304231604 in 161 msec 2023-02-13 16:03:54,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 16:03:54,480 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testInitTableSnapshotMapperJobConfig, region=aaa328fdf624aa5c6b4cb3ce9abda7d3, UNASSIGN in 165 msec 2023-02-13 16:03:54,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304234480"}]},"ts":"1676304234480"} 2023-02-13 16:03:54,482 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testInitTableSnapshotMapperJobConfig, state=DISABLED in hbase:meta 2023-02-13 16:03:54,483 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testInitTableSnapshotMapperJobConfig to state=DISABLED 2023-02-13 16:03:54,485 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testInitTableSnapshotMapperJobConfig in 178 msec 2023-02-13 16:03:54,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:03:54,613 INFO [Listener at localhost/34983] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 15 completed 2023-02-13 16:03:54,613 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,616 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,617 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 16:03:54,620 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:54,622 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1, FileablePath, hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2, FileablePath, hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/recovered.edits] 2023-02-13 16:03:54,626 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1/022a8e8185c74373b68fa045a32c5fcc to hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/archive/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1/022a8e8185c74373b68fa045a32c5fcc 2023-02-13 16:03:54,627 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1/c5fc2a2a82f74cffa1bfd026c9b7577c to hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/archive/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f1/c5fc2a2a82f74cffa1bfd026c9b7577c 2023-02-13 16:03:54,629 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2/0298fe4da21149dca09bfc2cc31fa693 to hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/archive/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2/0298fe4da21149dca09bfc2cc31fa693 2023-02-13 16:03:54,631 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2/f755034053694d84bf588185993442df to hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/archive/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/f2/f755034053694d84bf588185993442df 2023-02-13 16:03:54,633 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/recovered.edits/12.seqid to hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/archive/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3/recovered.edits/12.seqid 2023-02-13 16:03:54,634 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/.tmp/data/default/testInitTableSnapshotMapperJobConfig/aaa328fdf624aa5c6b4cb3ce9abda7d3 2023-02-13 16:03:54,634 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testInitTableSnapshotMapperJobConfig regions 2023-02-13 16:03:54,636 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,638 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testInitTableSnapshotMapperJobConfig from hbase:meta 2023-02-13 16:03:54,639 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testInitTableSnapshotMapperJobConfig' descriptor. 2023-02-13 16:03:54,640 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,640 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testInitTableSnapshotMapperJobConfig' from region states. 2023-02-13 16:03:54,640 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304234640"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:54,641 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 16:03:54,641 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aaa328fdf624aa5c6b4cb3ce9abda7d3, NAME => 'testInitTableSnapshotMapperJobConfig,,1676304232773.aaa328fdf624aa5c6b4cb3ce9abda7d3.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 16:03:54,641 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testInitTableSnapshotMapperJobConfig' as deleted. 2023-02-13 16:03:54,642 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testInitTableSnapshotMapperJobConfig","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676304234641"}]},"ts":"9223372036854775807"} 2023-02-13 16:03:54,645 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testInitTableSnapshotMapperJobConfig state from META 2023-02-13 16:03:54,650 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig 2023-02-13 16:03:54,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testInitTableSnapshotMapperJobConfig in 36 msec 2023-02-13 16:03:54,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 16:03:54,719 INFO [Listener at localhost/34983] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testInitTableSnapshotMapperJobConfig, procId: 18 completed 2023-02-13 16:03:54,719 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 16:03:54,719 INFO [Listener at localhost/34983] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 16:03:54,719 DEBUG [Listener at localhost/34983] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c94fbf3 to 127.0.0.1:51956 2023-02-13 16:03:54,719 DEBUG [Listener at localhost/34983] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:54,719 DEBUG [Listener at localhost/34983] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 16:03:54,720 DEBUG [Listener at localhost/34983] util.JVMClusterUtil(257): Found active master hash=286021417, stopped=false 2023-02-13 16:03:54,720 INFO [Listener at localhost/34983] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41951,1676304231555 2023-02-13 16:03:54,722 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:54,722 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:54,722 INFO [Listener at localhost/34983] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 16:03:54,722 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:54,722 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:54,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:54,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:54,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:54,724 DEBUG [Listener at localhost/34983] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x492aa2c3 to 127.0.0.1:51956 2023-02-13 16:03:54,724 DEBUG [Listener at localhost/34983] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:54,724 INFO [Listener at localhost/34983] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45217,1676304231604' ***** 2023-02-13 16:03:54,724 INFO [Listener at localhost/34983] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:03:54,724 INFO [Listener at localhost/34983] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,36263,1676304231635' ***** 2023-02-13 16:03:54,724 INFO [Listener at localhost/34983] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:03:54,725 INFO [RS:0;jenkins-hbase4:45217] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:03:54,725 INFO [RS:1;jenkins-hbase4:36263] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:03:54,725 INFO [RS:0;jenkins-hbase4:45217] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:03:54,725 INFO [RS:0;jenkins-hbase4:45217] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:03:54,725 INFO [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(3304): Received CLOSE for 718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:54,725 INFO [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:54,725 DEBUG [RS:0;jenkins-hbase4:45217] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f18d01b to 127.0.0.1:51956 2023-02-13 16:03:54,725 INFO [RS:1;jenkins-hbase4:36263] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:03:54,725 INFO [RS:1;jenkins-hbase4:36263] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:03:54,725 DEBUG [RS:0;jenkins-hbase4:45217] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:54,725 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:03:54,728 INFO [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 16:03:54,728 INFO [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,726 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:03:54,729 DEBUG [RS:1;jenkins-hbase4:36263] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a1b1ef2 to 127.0.0.1:51956 2023-02-13 16:03:54,730 DEBUG [RS:1;jenkins-hbase4:36263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:54,730 INFO [RS:1;jenkins-hbase4:36263] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:03:54,730 INFO [RS:1;jenkins-hbase4:36263] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:03:54,730 INFO [RS:1;jenkins-hbase4:36263] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:03:54,730 INFO [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 16:03:54,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 718fc4c0fcda0a7abfc8aadc3c4e811b, disabling compactions & flushes 2023-02-13 16:03:54,730 INFO [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 16:03:54,730 DEBUG [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 16:03:54,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:54,729 DEBUG [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1479): Online Regions={718fc4c0fcda0a7abfc8aadc3c4e811b=hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b.} 2023-02-13 16:03:54,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:03:54,731 DEBUG [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1505): Waiting on 718fc4c0fcda0a7abfc8aadc3c4e811b 2023-02-13 16:03:54,731 DEBUG [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 16:03:54,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:54,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:03:54,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. after waiting 0 ms 2023-02-13 16:03:54,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:03:54,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:54,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:03:54,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 718fc4c0fcda0a7abfc8aadc3c4e811b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 16:03:54,732 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:03:54,732 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.24 KB heapSize=7.64 KB 2023-02-13 16:03:54,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b/.tmp/info/190f46d5ce9642799422ac572f2406d6 2023-02-13 16:03:54,750 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.60 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/.tmp/info/dfff3a664cd346e58a1be540d46f3819 2023-02-13 16:03:54,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b/.tmp/info/190f46d5ce9642799422ac572f2406d6 as hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b/info/190f46d5ce9642799422ac572f2406d6 2023-02-13 16:03:54,754 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfff3a664cd346e58a1be540d46f3819 2023-02-13 16:03:54,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b/info/190f46d5ce9642799422ac572f2406d6, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 16:03:54,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 718fc4c0fcda0a7abfc8aadc3c4e811b in 27ms, sequenceid=6, compaction requested=false 2023-02-13 16:03:54,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=116 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/.tmp/rep_barrier/7cf3c55cf2d042bf84aaff8a19bf142f 2023-02-13 16:03:54,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/namespace/718fc4c0fcda0a7abfc8aadc3c4e811b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 16:03:54,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:54,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 718fc4c0fcda0a7abfc8aadc3c4e811b: Waiting for close lock at 1676304234725Running coprocessor pre-close hooks at 1676304234725Disabling compacts and flushes for region at 1676304234725Disabling writes for close at 1676304234731 (+6 ms)Obtaining lock to block concurrent updates at 1676304234732 (+1 ms)Preparing flush snapshotting stores in 718fc4c0fcda0a7abfc8aadc3c4e811b at 1676304234732Finished memstore snapshotting hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676304234732Flushing stores of hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. at 1676304234732Flushing 718fc4c0fcda0a7abfc8aadc3c4e811b/info: creating writer at 1676304234732Flushing 718fc4c0fcda0a7abfc8aadc3c4e811b/info: appending metadata at 1676304234735 (+3 ms)Flushing 718fc4c0fcda0a7abfc8aadc3c4e811b/info: closing flushed file at 1676304234735Flushing 718fc4c0fcda0a7abfc8aadc3c4e811b/info: reopening flushed file at 1676304234754 (+19 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 718fc4c0fcda0a7abfc8aadc3c4e811b in 27ms, sequenceid=6, compaction requested=false at 1676304234759 (+5 ms)Writing region close event to WAL at 1676304234764 (+5 ms)Running coprocessor post-close hooks at 1676304234767 (+3 ms)Closed at 1676304234768 (+1 ms) 2023-02-13 16:03:54,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676304232226.718fc4c0fcda0a7abfc8aadc3c4e811b. 2023-02-13 16:03:54,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7cf3c55cf2d042bf84aaff8a19bf142f 2023-02-13 16:03:54,777 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=542 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/.tmp/table/273760f065fa4e5d91c1fb8629a4a22b 2023-02-13 16:03:54,780 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 273760f065fa4e5d91c1fb8629a4a22b 2023-02-13 16:03:54,781 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/.tmp/info/dfff3a664cd346e58a1be540d46f3819 as hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/info/dfff3a664cd346e58a1be540d46f3819 2023-02-13 16:03:54,785 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfff3a664cd346e58a1be540d46f3819 2023-02-13 16:03:54,785 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/info/dfff3a664cd346e58a1be540d46f3819, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 16:03:54,786 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/.tmp/rep_barrier/7cf3c55cf2d042bf84aaff8a19bf142f as hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/rep_barrier/7cf3c55cf2d042bf84aaff8a19bf142f 2023-02-13 16:03:54,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7cf3c55cf2d042bf84aaff8a19bf142f 2023-02-13 16:03:54,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/rep_barrier/7cf3c55cf2d042bf84aaff8a19bf142f, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 16:03:54,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/.tmp/table/273760f065fa4e5d91c1fb8629a4a22b as hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/table/273760f065fa4e5d91c1fb8629a4a22b 2023-02-13 16:03:54,793 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 273760f065fa4e5d91c1fb8629a4a22b 2023-02-13 16:03:54,793 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/table/273760f065fa4e5d91c1fb8629a4a22b, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 16:03:54,794 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 62ms, sequenceid=21, compaction requested=false 2023-02-13 16:03:54,797 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 16:03:54,798 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 16:03:54,799 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:03:54,799 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304234730Running coprocessor pre-close hooks at 1676304234730Disabling compacts and flushes for region at 1676304234730Disabling writes for close at 1676304234732 (+2 ms)Obtaining lock to block concurrent updates at 1676304234732Preparing flush snapshotting stores in 1588230740 at 1676304234732Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4340, getHeapSize=7776, getOffHeapSize=0, getCellsCount=36 at 1676304234732Flushing stores of hbase:meta,,1.1588230740 at 1676304234732Flushing 1588230740/info: creating writer at 1676304234732Flushing 1588230740/info: appending metadata at 1676304234735 (+3 ms)Flushing 1588230740/info: closing flushed file at 1676304234735Flushing 1588230740/rep_barrier: creating writer at 1676304234755 (+20 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676304234757 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676304234757Flushing 1588230740/table: creating writer at 1676304234771 (+14 ms)Flushing 1588230740/table: appending metadata at 1676304234772 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676304234773 (+1 ms)Flushing 1588230740/info: reopening flushed file at 1676304234782 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676304234786 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676304234790 (+4 ms)Finished flush of dataSize ~4.24 KB/4340, heapSize ~7.59 KB/7776, currentSize=0 B/0 for 1588230740 in 62ms, sequenceid=21, compaction requested=false at 1676304234794 (+4 ms)Writing region close event to WAL at 1676304234795 (+1 ms)Running coprocessor post-close hooks at 1676304234798 (+3 ms)Closed at 1676304234799 (+1 ms) 2023-02-13 16:03:54,799 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 16:03:54,818 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:54,818 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:54,917 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 16:03:54,917 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 16:03:54,931 INFO [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45217,1676304231604; all regions closed. 2023-02-13 16:03:54,931 INFO [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,36263,1676304231635; all regions closed. 2023-02-13 16:03:54,938 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/WALs/jenkins-hbase4.apache.org,45217,1676304231604/jenkins-hbase4.apache.org%2C45217%2C1676304231604.1676304232580 not finished, retry = 0 2023-02-13 16:03:54,940 DEBUG [RS:1;jenkins-hbase4:36263] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/oldWALs 2023-02-13 16:03:54,940 INFO [RS:1;jenkins-hbase4:36263] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36263%2C1676304231635.meta:.meta(num 1676304232165) 2023-02-13 16:03:54,944 DEBUG [RS:1;jenkins-hbase4:36263] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/oldWALs 2023-02-13 16:03:54,944 INFO [RS:1;jenkins-hbase4:36263] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36263%2C1676304231635:(num 1676304232943) 2023-02-13 16:03:54,944 DEBUG [RS:1;jenkins-hbase4:36263] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:54,944 INFO [RS:1;jenkins-hbase4:36263] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:54,944 INFO [RS:1;jenkins-hbase4:36263] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 16:03:54,945 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:03:54,945 INFO [RS:1;jenkins-hbase4:36263] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36263 2023-02-13 16:03:54,947 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:54,947 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,947 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36263,1676304231635 2023-02-13 16:03:54,947 ERROR [Listener at localhost/34983-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5caa72f2 rejected from java.util.concurrent.ThreadPoolExecutor@5895edbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:54,947 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:54,948 ERROR [Listener at localhost/34983-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@23f2ce4a rejected from java.util.concurrent.ThreadPoolExecutor@5895edbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:54,948 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36263,1676304231635] 2023-02-13 16:03:54,947 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:54,948 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36263,1676304231635; numProcessing=1 2023-02-13 16:03:54,950 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36263,1676304231635 already deleted, retry=false 2023-02-13 16:03:54,950 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36263,1676304231635 expired; onlineServers=1 2023-02-13 16:03:55,041 DEBUG [RS:0;jenkins-hbase4:45217] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/oldWALs 2023-02-13 16:03:55,041 INFO [RS:0;jenkins-hbase4:45217] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45217%2C1676304231604:(num 1676304232580) 2023-02-13 16:03:55,041 DEBUG [RS:0;jenkins-hbase4:45217] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:55,041 INFO [RS:0;jenkins-hbase4:45217] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:03:55,041 INFO [RS:0;jenkins-hbase4:45217] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 16:03:55,041 INFO [RS:0;jenkins-hbase4:45217] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:03:55,041 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:03:55,041 INFO [RS:0;jenkins-hbase4:45217] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:03:55,041 INFO [RS:0;jenkins-hbase4:45217] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:03:55,042 INFO [RS:0;jenkins-hbase4:45217] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45217 2023-02-13 16:03:55,044 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45217,1676304231604 2023-02-13 16:03:55,044 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:55,044 ERROR [Listener at localhost/34983-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@508126ca rejected from java.util.concurrent.ThreadPoolExecutor@54bea802[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:55,047 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45217,1676304231604] 2023-02-13 16:03:55,047 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45217,1676304231604; numProcessing=2 2023-02-13 16:03:55,048 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45217,1676304231604 already deleted, retry=false 2023-02-13 16:03:55,048 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45217,1676304231604 expired; onlineServers=0 2023-02-13 16:03:55,048 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,41951,1676304231555' ***** 2023-02-13 16:03:55,048 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 16:03:55,049 DEBUG [M:0;jenkins-hbase4:41951] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1533d1d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:55,049 INFO [M:0;jenkins-hbase4:41951] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,41951,1676304231555 2023-02-13 16:03:55,049 INFO [M:0;jenkins-hbase4:41951] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,41951,1676304231555; all regions closed. 2023-02-13 16:03:55,049 DEBUG [M:0;jenkins-hbase4:41951] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:55,049 DEBUG [M:0;jenkins-hbase4:41951] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 16:03:55,049 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 16:03:55,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304231806] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304231806,5,FailOnTimeoutGroup] 2023-02-13 16:03:55,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304231806] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304231806,5,FailOnTimeoutGroup] 2023-02-13 16:03:55,049 DEBUG [M:0;jenkins-hbase4:41951] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 16:03:55,050 INFO [M:0;jenkins-hbase4:41951] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 16:03:55,051 INFO [M:0;jenkins-hbase4:41951] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 16:03:55,051 INFO [M:0;jenkins-hbase4:41951] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 16:03:55,051 DEBUG [M:0;jenkins-hbase4:41951] master.HMaster(1502): Stopping service threads 2023-02-13 16:03:55,051 INFO [M:0;jenkins-hbase4:41951] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 16:03:55,051 ERROR [M:0;jenkins-hbase4:41951] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 16:03:55,051 INFO [M:0;jenkins-hbase4:41951] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 16:03:55,052 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 16:03:55,053 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:55,053 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:55,053 DEBUG [M:0;jenkins-hbase4:41951] zookeeper.ZKUtil(398): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 16:03:55,053 WARN [M:0;jenkins-hbase4:41951] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 16:03:55,053 INFO [M:0;jenkins-hbase4:41951] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 16:03:55,054 INFO [M:0;jenkins-hbase4:41951] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 16:03:55,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:55,054 DEBUG [M:0;jenkins-hbase4:41951] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:03:55,055 INFO [M:0;jenkins-hbase4:41951] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:55,055 DEBUG [M:0;jenkins-hbase4:41951] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:55,055 DEBUG [M:0;jenkins-hbase4:41951] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:03:55,055 DEBUG [M:0;jenkins-hbase4:41951] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:55,055 INFO [M:0;jenkins-hbase4:41951] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=55.88 KB heapSize=66.81 KB 2023-02-13 16:03:55,068 INFO [M:0;jenkins-hbase4:41951] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=55.88 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3a2a829ba63846d8831aa8cf0c36eecc 2023-02-13 16:03:55,074 DEBUG [M:0;jenkins-hbase4:41951] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3a2a829ba63846d8831aa8cf0c36eecc as hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3a2a829ba63846d8831aa8cf0c36eecc 2023-02-13 16:03:55,079 INFO [M:0;jenkins-hbase4:41951] regionserver.HStore(1080): Added hdfs://localhost:41017/user/jenkins/test-data/1acacad4-b2ac-2f0a-7a69-2c9e29893c8a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3a2a829ba63846d8831aa8cf0c36eecc, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 16:03:55,080 INFO [M:0;jenkins-hbase4:41951] regionserver.HRegion(2947): Finished flush of dataSize ~55.88 KB/57217, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=132, compaction requested=false 2023-02-13 16:03:55,080 INFO [M:0;jenkins-hbase4:41951] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:55,080 DEBUG [M:0;jenkins-hbase4:41951] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304235054Disabling compacts and flushes for region at 1676304235054Disabling writes for close at 1676304235055 (+1 ms)Obtaining lock to block concurrent updates at 1676304235055Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676304235055Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57217, getHeapSize=68400, getOffHeapSize=0, getCellsCount=145 at 1676304235055Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676304235056 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676304235056Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676304235058 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676304235058Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676304235074 (+16 ms)Finished flush of dataSize ~55.88 KB/57217, heapSize ~66.80 KB/68400, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=132, compaction requested=false at 1676304235080 (+6 ms)Writing region close event to WAL at 1676304235080Closed at 1676304235080 2023-02-13 16:03:55,084 INFO [M:0;jenkins-hbase4:41951] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 16:03:55,084 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:03:55,085 INFO [M:0;jenkins-hbase4:41951] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41951 2023-02-13 16:03:55,086 DEBUG [M:0;jenkins-hbase4:41951] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41951,1676304231555 already deleted, retry=false 2023-02-13 16:03:55,224 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:55,224 INFO [M:0;jenkins-hbase4:41951] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,41951,1676304231555; zookeeper connection closed. 2023-02-13 16:03:55,224 ERROR [Listener at localhost/34983-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a6a94 rejected from java.util.concurrent.ThreadPoolExecutor@455fe41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:55,225 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): master:41951-0x1004e6c96360000, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:55,225 ERROR [Listener at localhost/34983-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@233161a9 rejected from java.util.concurrent.ThreadPoolExecutor@455fe41[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:55,324 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:55,324 INFO [RS:0;jenkins-hbase4:45217] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45217,1676304231604; zookeeper connection closed. 2023-02-13 16:03:55,324 ERROR [Listener at localhost/34983-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@790920e7 rejected from java.util.concurrent.ThreadPoolExecutor@54bea802[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:55,324 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:45217-0x1004e6c96360001, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:55,324 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4d5efdd6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4d5efdd6 2023-02-13 16:03:55,324 ERROR [Listener at localhost/34983-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b8acdc rejected from java.util.concurrent.ThreadPoolExecutor@54bea802[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:55,424 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:55,424 INFO [RS:1;jenkins-hbase4:36263] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,36263,1676304231635; zookeeper connection closed. 2023-02-13 16:03:55,424 ERROR [Listener at localhost/34983-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5bcfed06 rejected from java.util.concurrent.ThreadPoolExecutor@5895edbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:55,424 DEBUG [Listener at localhost/34983-EventThread] zookeeper.ZKWatcher(600): regionserver:36263-0x1004e6c96360002, quorum=127.0.0.1:51956, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:03:55,424 ERROR [Listener at localhost/34983-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@480d96e5 rejected from java.util.concurrent.ThreadPoolExecutor@5895edbf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:03:55,424 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@12dc8064] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@12dc8064 2023-02-13 16:03:55,425 INFO [Listener at localhost/34983] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 16:03:55,425 WARN [Listener at localhost/34983] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:03:55,431 INFO [Listener at localhost/34983] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:03:55,535 WARN [BP-1143939874-172.31.14.131-1676304230854 heartbeating to localhost/127.0.0.1:41017] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:03:55,536 WARN [BP-1143939874-172.31.14.131-1676304230854 heartbeating to localhost/127.0.0.1:41017] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1143939874-172.31.14.131-1676304230854 (Datanode Uuid df88c89b-4962-49fc-9db5-e251cac89627) service to localhost/127.0.0.1:41017 2023-02-13 16:03:55,536 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/cluster_7a5a527d-2c9a-337c-3b61-683b96b45d10/dfs/data/data3/current/BP-1143939874-172.31.14.131-1676304230854] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:55,537 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/cluster_7a5a527d-2c9a-337c-3b61-683b96b45d10/dfs/data/data4/current/BP-1143939874-172.31.14.131-1676304230854] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:55,538 WARN [Listener at localhost/34983] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:03:55,543 INFO [Listener at localhost/34983] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:03:55,648 WARN [BP-1143939874-172.31.14.131-1676304230854 heartbeating to localhost/127.0.0.1:41017] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:03:55,648 WARN [BP-1143939874-172.31.14.131-1676304230854 heartbeating to localhost/127.0.0.1:41017] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1143939874-172.31.14.131-1676304230854 (Datanode Uuid 269487d0-1ded-4e6f-a432-d558cae09e72) service to localhost/127.0.0.1:41017 2023-02-13 16:03:55,649 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/cluster_7a5a527d-2c9a-337c-3b61-683b96b45d10/dfs/data/data1/current/BP-1143939874-172.31.14.131-1676304230854] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:55,649 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/cluster_7a5a527d-2c9a-337c-3b61-683b96b45d10/dfs/data/data2/current/BP-1143939874-172.31.14.131-1676304230854] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:03:55,659 INFO [Listener at localhost/34983] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:03:55,773 INFO [Listener at localhost/34983] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 16:03:55,794 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 16:03:55,806 INFO [Listener at localhost/34983] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testInitTableSnapshotMapperJobConfig Thread=180 (was 155) Potentially hanging thread: RS-EventLoopGroup-11-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-8 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-11-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:41017 from jenkins.hfs.4 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-10-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41017 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/34983 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:41017 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:41017 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:41017 from jenkins.hfs.5 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-9 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.5@localhost:41017 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-13-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41951,1676304231555)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-9-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.4@localhost:41017 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-12-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-10-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-10-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-11-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=565 (was 529) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=313 (was 305) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=1637 (was 1662) 2023-02-13 16:03:55,815 INFO [Listener at localhost/34983] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=180, OpenFileDescriptor=565, MaxFileDescriptor=60000, SystemLoadAverage=313, ProcessCount=165, AvailableMemoryMB=1636 2023-02-13 16:03:55,826 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/hadoop.log.dir so I do NOT create it in target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba 2023-02-13 16:03:55,826 WARN [Listener at localhost/34983] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 16:03:55,826 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/hadoop.tmp.dir so I do NOT create it in target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba 2023-02-13 16:03:55,826 WARN [Listener at localhost/34983] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/addae23e-52b4-fd0a-b6ab-123c626fc4a7/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 16:03:55,826 DEBUG [Listener at localhost/34983] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba 2023-02-13 16:03:55,826 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 16:03:55,826 INFO [Listener at localhost/34983] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/cluster_c00fdadd-e225-6c97-0371-7ad55931f5ad, deleteOnExit=true 2023-02-13 16:03:55,826 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 16:03:55,826 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/test.cache.data in system properties and HBase conf 2023-02-13 16:03:55,827 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 16:03:55,827 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/hadoop.log.dir in system properties and HBase conf 2023-02-13 16:03:55,827 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 16:03:55,827 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 16:03:55,827 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 16:03:55,827 DEBUG [Listener at localhost/34983] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 16:03:55,827 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:03:55,827 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:03:55,827 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 16:03:55,827 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:03:55,828 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 16:03:55,828 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 16:03:55,828 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:03:55,828 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:03:55,828 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 16:03:55,828 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/nfs.dump.dir in system properties and HBase conf 2023-02-13 16:03:55,828 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/java.io.tmpdir in system properties and HBase conf 2023-02-13 16:03:55,828 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:03:55,828 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 16:03:55,828 INFO [Listener at localhost/34983] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 16:03:55,832 WARN [Listener at localhost/34983] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:03:55,833 WARN [Listener at localhost/34983] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:03:55,871 WARN [Listener at localhost/34983] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:55,873 INFO [Listener at localhost/34983] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:55,879 INFO [Listener at localhost/34983] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/java.io.tmpdir/Jetty_localhost_44667_hdfs____1703oh/webapp 2023-02-13 16:03:55,970 INFO [Listener at localhost/34983] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44667 2023-02-13 16:03:55,974 WARN [Listener at localhost/34983] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:03:55,975 WARN [Listener at localhost/34983] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:03:56,014 WARN [Listener at localhost/45659] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:56,029 WARN [Listener at localhost/45659] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:03:56,032 WARN [Listener at localhost/45659] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:56,033 INFO [Listener at localhost/45659] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:56,042 INFO [Listener at localhost/45659] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/java.io.tmpdir/Jetty_localhost_39201_datanode____ut7pbo/webapp 2023-02-13 16:03:56,137 INFO [Listener at localhost/45659] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39201 2023-02-13 16:03:56,143 WARN [Listener at localhost/44037] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:56,158 WARN [Listener at localhost/44037] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:03:56,161 WARN [Listener at localhost/44037] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:03:56,162 INFO [Listener at localhost/44037] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:03:56,167 INFO [Listener at localhost/44037] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/java.io.tmpdir/Jetty_localhost_41303_datanode____.63fcn4/webapp 2023-02-13 16:03:56,245 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x96cab284cff692fc: Processing first storage report for DS-e9173e01-37ea-4b5e-bcb6-96307cbb5eed from datanode dee96792-01d2-4b51-ab73-54f9a37aa9b6 2023-02-13 16:03:56,245 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x96cab284cff692fc: from storage DS-e9173e01-37ea-4b5e-bcb6-96307cbb5eed node DatanodeRegistration(127.0.0.1:34139, datanodeUuid=dee96792-01d2-4b51-ab73-54f9a37aa9b6, infoPort=43107, infoSecurePort=0, ipcPort=44037, storageInfo=lv=-57;cid=testClusterID;nsid=823195760;c=1676304235835), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:56,245 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x96cab284cff692fc: Processing first storage report for DS-ce9de293-7fb1-404d-a774-f02bb24c9fcd from datanode dee96792-01d2-4b51-ab73-54f9a37aa9b6 2023-02-13 16:03:56,245 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x96cab284cff692fc: from storage DS-ce9de293-7fb1-404d-a774-f02bb24c9fcd node DatanodeRegistration(127.0.0.1:34139, datanodeUuid=dee96792-01d2-4b51-ab73-54f9a37aa9b6, infoPort=43107, infoSecurePort=0, ipcPort=44037, storageInfo=lv=-57;cid=testClusterID;nsid=823195760;c=1676304235835), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:56,272 INFO [Listener at localhost/44037] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41303 2023-02-13 16:03:56,279 WARN [Listener at localhost/35815] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:03:56,375 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe9943eba44370cc1: Processing first storage report for DS-e6eb5970-aba4-4f5e-bcc2-eb7053a69fcb from datanode 0f07c91d-11a3-4042-af14-51234206b64c 2023-02-13 16:03:56,375 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe9943eba44370cc1: from storage DS-e6eb5970-aba4-4f5e-bcc2-eb7053a69fcb node DatanodeRegistration(127.0.0.1:42309, datanodeUuid=0f07c91d-11a3-4042-af14-51234206b64c, infoPort=44709, infoSecurePort=0, ipcPort=35815, storageInfo=lv=-57;cid=testClusterID;nsid=823195760;c=1676304235835), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:56,375 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe9943eba44370cc1: Processing first storage report for DS-6395e593-06c6-4cc1-952d-10a5ac0b22ff from datanode 0f07c91d-11a3-4042-af14-51234206b64c 2023-02-13 16:03:56,375 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe9943eba44370cc1: from storage DS-6395e593-06c6-4cc1-952d-10a5ac0b22ff node DatanodeRegistration(127.0.0.1:42309, datanodeUuid=0f07c91d-11a3-4042-af14-51234206b64c, infoPort=44709, infoSecurePort=0, ipcPort=35815, storageInfo=lv=-57;cid=testClusterID;nsid=823195760;c=1676304235835), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:03:56,388 DEBUG [Listener at localhost/35815] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba 2023-02-13 16:03:56,390 INFO [Listener at localhost/35815] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/cluster_c00fdadd-e225-6c97-0371-7ad55931f5ad/zookeeper_0, clientPort=62288, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/cluster_c00fdadd-e225-6c97-0371-7ad55931f5ad/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/cluster_c00fdadd-e225-6c97-0371-7ad55931f5ad/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 16:03:56,391 INFO [Listener at localhost/35815] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62288 2023-02-13 16:03:56,391 INFO [Listener at localhost/35815] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,392 INFO [Listener at localhost/35815] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,405 INFO [Listener at localhost/35815] util.FSUtils(479): Created version file at hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40 with version=8 2023-02-13 16:03:56,406 INFO [Listener at localhost/35815] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,406 INFO [Listener at localhost/35815] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,407 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/hbase-staging 2023-02-13 16:03:56,409 INFO [Listener at localhost/35815] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:56,409 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:56,409 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:56,409 INFO [Listener at localhost/35815] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:56,410 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:56,410 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:56,410 INFO [Listener at localhost/35815] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:56,410 INFO [Listener at localhost/35815] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39489 2023-02-13 16:03:56,411 INFO [Listener at localhost/35815] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,411 INFO [Listener at localhost/35815] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,412 INFO [Listener at localhost/35815] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39489 connecting to ZooKeeper ensemble=127.0.0.1:62288 2023-02-13 16:03:56,419 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:394890x0, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:56,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:39489-0x1004e6ca92b0000 connected 2023-02-13 16:03:56,441 DEBUG [Listener at localhost/35815] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:56,441 DEBUG [Listener at localhost/35815] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:56,442 DEBUG [Listener at localhost/35815] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:56,443 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39489 2023-02-13 16:03:56,444 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39489 2023-02-13 16:03:56,448 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39489 2023-02-13 16:03:56,448 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39489 2023-02-13 16:03:56,448 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39489 2023-02-13 16:03:56,448 INFO [Listener at localhost/35815] master.HMaster(439): hbase.rootdir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40, hbase.cluster.distributed=false 2023-02-13 16:03:56,461 INFO [Listener at localhost/35815] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:56,461 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:56,461 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:56,461 INFO [Listener at localhost/35815] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:56,461 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:56,461 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:56,462 INFO [Listener at localhost/35815] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:56,462 INFO [Listener at localhost/35815] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44631 2023-02-13 16:03:56,463 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:03:56,464 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:56,464 INFO [Listener at localhost/35815] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,465 INFO [Listener at localhost/35815] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,466 INFO [Listener at localhost/35815] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44631 connecting to ZooKeeper ensemble=127.0.0.1:62288 2023-02-13 16:03:56,469 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:446310x0, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:56,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44631-0x1004e6ca92b0001 connected 2023-02-13 16:03:56,472 DEBUG [Listener at localhost/35815] zookeeper.ZKUtil(164): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:56,473 DEBUG [Listener at localhost/35815] zookeeper.ZKUtil(164): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:56,473 DEBUG [Listener at localhost/35815] zookeeper.ZKUtil(164): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:56,476 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44631 2023-02-13 16:03:56,476 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44631 2023-02-13 16:03:56,480 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44631 2023-02-13 16:03:56,480 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44631 2023-02-13 16:03:56,480 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44631 2023-02-13 16:03:56,491 INFO [Listener at localhost/35815] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:03:56,491 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:56,492 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:56,492 INFO [Listener at localhost/35815] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:03:56,492 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:03:56,492 INFO [Listener at localhost/35815] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:03:56,492 INFO [Listener at localhost/35815] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:03:56,493 INFO [Listener at localhost/35815] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45019 2023-02-13 16:03:56,493 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:03:56,494 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:03:56,495 INFO [Listener at localhost/35815] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,496 INFO [Listener at localhost/35815] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,497 INFO [Listener at localhost/35815] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45019 connecting to ZooKeeper ensemble=127.0.0.1:62288 2023-02-13 16:03:56,536 DEBUG [Listener at localhost/35815] zookeeper.ZKUtil(164): regionserver:450190x0, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:03:56,537 DEBUG [Listener at localhost/35815] zookeeper.ZKUtil(164): regionserver:450190x0, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:03:56,537 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:450190x0, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:03:56,539 DEBUG [Listener at localhost/35815] zookeeper.ZKUtil(164): regionserver:450190x0, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:03:56,571 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45019-0x1004e6ca92b0002 connected 2023-02-13 16:03:56,574 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45019 2023-02-13 16:03:56,574 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45019 2023-02-13 16:03:56,574 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45019 2023-02-13 16:03:56,575 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45019 2023-02-13 16:03:56,575 DEBUG [Listener at localhost/35815] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45019 2023-02-13 16:03:56,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39489,1676304236409 2023-02-13 16:03:56,578 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:03:56,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39489,1676304236409 2023-02-13 16:03:56,581 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:56,581 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:56,581 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:56,581 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:03:56,583 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:03:56,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:03:56,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39489,1676304236409 from backup master directory 2023-02-13 16:03:56,585 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39489,1676304236409 2023-02-13 16:03:56,585 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:03:56,585 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:56,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,39489,1676304236409 2023-02-13 16:03:56,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/hbase.id with ID: 47cfabe4-0d7a-4b4d-a2d6-2061f2e65a6c 2023-02-13 16:03:56,607 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:03:56,610 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:56,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5b5d8a96 to 127.0.0.1:62288 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:56,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24931ca9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:56,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:56,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 16:03:56,621 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:56,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/data/master/store-tmp 2023-02-13 16:03:56,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:56,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:03:56,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:56,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:56,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:03:56,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:56,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:03:56,630 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304236630Disabling compacts and flushes for region at 1676304236630Disabling writes for close at 1676304236630Writing region close event to WAL at 1676304236630Closed at 1676304236630 2023-02-13 16:03:56,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/WALs/jenkins-hbase4.apache.org,39489,1676304236409 2023-02-13 16:03:56,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39489%2C1676304236409, suffix=, logDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/WALs/jenkins-hbase4.apache.org,39489,1676304236409, archiveDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/oldWALs, maxLogs=10 2023-02-13 16:03:56,650 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42309,DS-e6eb5970-aba4-4f5e-bcc2-eb7053a69fcb,DISK] 2023-02-13 16:03:56,651 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34139,DS-e9173e01-37ea-4b5e-bcb6-96307cbb5eed,DISK] 2023-02-13 16:03:56,652 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/WALs/jenkins-hbase4.apache.org,39489,1676304236409/jenkins-hbase4.apache.org%2C39489%2C1676304236409.1676304236634 2023-02-13 16:03:56,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34139,DS-e9173e01-37ea-4b5e-bcb6-96307cbb5eed,DISK], DatanodeInfoWithStorage[127.0.0.1:42309,DS-e6eb5970-aba4-4f5e-bcc2-eb7053a69fcb,DISK]] 2023-02-13 16:03:56,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:56,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:56,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:56,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:56,654 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:56,655 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 16:03:56,656 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 16:03:56,656 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:56,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:56,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:56,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:03:56,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:56,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59602606, jitterRate=-0.11185196042060852}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:03:56,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676304236653Initializing all the Stores at 1676304236654 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304236654Cleaning up temporary data from old regions at 1676304236658 (+4 ms)Cleaning up detritus from prior splits at 1676304236658Region opened successfully at 1676304236662 (+4 ms) 2023-02-13 16:03:56,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 16:03:56,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 16:03:56,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 16:03:56,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 16:03:56,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 16:03:56,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 16:03:56,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 16:03:56,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 16:03:56,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 16:03:56,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 16:03:56,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 16:03:56,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 16:03:56,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 16:03:56,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 16:03:56,683 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:56,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 16:03:56,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 16:03:56,684 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 16:03:56,685 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:56,685 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:56,685 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:03:56,685 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:56,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,39489,1676304236409, sessionid=0x1004e6ca92b0000, setting cluster-up flag (Was=false) 2023-02-13 16:03:56,690 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:56,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 16:03:56,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39489,1676304236409 2023-02-13 16:03:56,700 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:56,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 16:03:56,704 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39489,1676304236409 2023-02-13 16:03:56,704 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.hbase-snapshot/.tmp 2023-02-13 16:03:56,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:56,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:56,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:56,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:56,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:03:56,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 16:03:56,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:56,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676304266714 2023-02-13 16:03:56,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 16:03:56,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 16:03:56,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 16:03:56,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 16:03:56,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 16:03:56,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 16:03:56,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,715 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:56,715 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 16:03:56,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 16:03:56,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 16:03:56,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 16:03:56,716 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:56,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 16:03:56,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 16:03:56,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304236717,5,FailOnTimeoutGroup] 2023-02-13 16:03:56,720 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304236720,5,FailOnTimeoutGroup] 2023-02-13 16:03:56,720 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 16:03:56,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,731 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:56,732 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:56,732 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40 2023-02-13 16:03:56,739 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:56,740 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:03:56,741 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/info 2023-02-13 16:03:56,742 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:03:56,742 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:56,742 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:03:56,744 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:56,744 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:03:56,744 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:56,745 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:03:56,746 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/table 2023-02-13 16:03:56,746 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:03:56,747 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:56,747 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740 2023-02-13 16:03:56,748 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740 2023-02-13 16:03:56,750 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:03:56,751 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:03:56,753 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:56,754 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67256436, jitterRate=0.0021989941596984863}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:03:56,754 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676304236739Initializing all the Stores at 1676304236740 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304236740Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304236740Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304236740Cleaning up temporary data from old regions at 1676304236749 (+9 ms)Cleaning up detritus from prior splits at 1676304236749Region opened successfully at 1676304236754 (+5 ms) 2023-02-13 16:03:56,754 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:03:56,754 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:03:56,754 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:03:56,754 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:03:56,754 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:03:56,755 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:03:56,755 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304236754Disabling compacts and flushes for region at 1676304236754Disabling writes for close at 1676304236754Writing region close event to WAL at 1676304236755 (+1 ms)Closed at 1676304236755 2023-02-13 16:03:56,755 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:03:56,755 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 16:03:56,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 16:03:56,757 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 16:03:56,758 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 16:03:56,777 INFO [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(952): ClusterId : 47cfabe4-0d7a-4b4d-a2d6-2061f2e65a6c 2023-02-13 16:03:56,777 INFO [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(952): ClusterId : 47cfabe4-0d7a-4b4d-a2d6-2061f2e65a6c 2023-02-13 16:03:56,777 DEBUG [RS:0;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:03:56,777 DEBUG [RS:1;jenkins-hbase4:45019] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:03:56,782 DEBUG [RS:0;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:03:56,782 DEBUG [RS:0;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:03:56,782 DEBUG [RS:1;jenkins-hbase4:45019] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:03:56,782 DEBUG [RS:1;jenkins-hbase4:45019] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:03:56,784 DEBUG [RS:0;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:03:56,786 DEBUG [RS:1;jenkins-hbase4:45019] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:03:56,786 DEBUG [RS:0;jenkins-hbase4:44631] zookeeper.ReadOnlyZKClient(139): Connect 0x2c737fe2 to 127.0.0.1:62288 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:56,787 DEBUG [RS:1;jenkins-hbase4:45019] zookeeper.ReadOnlyZKClient(139): Connect 0x4ea41aed to 127.0.0.1:62288 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:56,798 DEBUG [RS:0;jenkins-hbase4:44631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22b4841c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:56,798 DEBUG [RS:1;jenkins-hbase4:45019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4063fd49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:56,798 DEBUG [RS:0;jenkins-hbase4:44631] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@268b1492, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:56,799 DEBUG [RS:1;jenkins-hbase4:45019] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@445c719d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:03:56,807 DEBUG [RS:0;jenkins-hbase4:44631] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44631 2023-02-13 16:03:56,807 INFO [RS:0;jenkins-hbase4:44631] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:03:56,807 INFO [RS:0;jenkins-hbase4:44631] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:03:56,807 DEBUG [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:03:56,808 INFO [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39489,1676304236409 with isa=jenkins-hbase4.apache.org/172.31.14.131:44631, startcode=1676304236460 2023-02-13 16:03:56,808 DEBUG [RS:0;jenkins-hbase4:44631] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:03:56,808 DEBUG [RS:1;jenkins-hbase4:45019] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45019 2023-02-13 16:03:56,809 INFO [RS:1;jenkins-hbase4:45019] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:03:56,809 INFO [RS:1;jenkins-hbase4:45019] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:03:56,809 DEBUG [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:03:56,809 INFO [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,39489,1676304236409 with isa=jenkins-hbase4.apache.org/172.31.14.131:45019, startcode=1676304236491 2023-02-13 16:03:56,809 DEBUG [RS:1;jenkins-hbase4:45019] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:03:56,810 INFO [RS-EventLoopGroup-12-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51715, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.6 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:03:56,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:56,812 INFO [RS-EventLoopGroup-12-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34353, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.7 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:03:56,812 DEBUG [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40 2023-02-13 16:03:56,812 DEBUG [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45659 2023-02-13 16:03:56,813 DEBUG [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:03:56,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:56,813 DEBUG [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40 2023-02-13 16:03:56,813 DEBUG [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45659 2023-02-13 16:03:56,813 DEBUG [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:03:56,814 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:03:56,818 DEBUG [RS:0;jenkins-hbase4:44631] zookeeper.ZKUtil(162): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:56,818 WARN [RS:0;jenkins-hbase4:44631] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:56,818 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44631,1676304236460] 2023-02-13 16:03:56,818 INFO [RS:0;jenkins-hbase4:44631] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:56,818 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45019,1676304236491] 2023-02-13 16:03:56,818 DEBUG [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/WALs/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:56,818 DEBUG [RS:1;jenkins-hbase4:45019] zookeeper.ZKUtil(162): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:56,819 WARN [RS:1;jenkins-hbase4:45019] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:03:56,819 INFO [RS:1;jenkins-hbase4:45019] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:56,819 DEBUG [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/WALs/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:56,824 DEBUG [RS:0;jenkins-hbase4:44631] zookeeper.ZKUtil(162): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:56,824 DEBUG [RS:0;jenkins-hbase4:44631] zookeeper.ZKUtil(162): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:56,824 DEBUG [RS:1;jenkins-hbase4:45019] zookeeper.ZKUtil(162): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:56,824 DEBUG [RS:1;jenkins-hbase4:45019] zookeeper.ZKUtil(162): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:56,825 DEBUG [RS:0;jenkins-hbase4:44631] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:03:56,825 INFO [RS:0;jenkins-hbase4:44631] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:03:56,826 DEBUG [RS:1;jenkins-hbase4:45019] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:03:56,826 INFO [RS:1;jenkins-hbase4:45019] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:03:56,827 INFO [RS:0;jenkins-hbase4:44631] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:03:56,828 INFO [RS:1;jenkins-hbase4:45019] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:03:56,829 INFO [RS:0;jenkins-hbase4:44631] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:03:56,829 INFO [RS:0;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,830 INFO [RS:1;jenkins-hbase4:45019] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:03:56,830 INFO [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:03:56,830 INFO [RS:1;jenkins-hbase4:45019] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,831 INFO [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:03:56,832 INFO [RS:0;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,832 INFO [RS:1;jenkins-hbase4:45019] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,832 DEBUG [RS:0;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:0;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:1;jenkins-hbase4:45019] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:0;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:1;jenkins-hbase4:45019] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:0;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:1;jenkins-hbase4:45019] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:0;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:1;jenkins-hbase4:45019] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:0;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:56,833 DEBUG [RS:1;jenkins-hbase4:45019] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:0;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:1;jenkins-hbase4:45019] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:03:56,833 DEBUG [RS:0;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:1;jenkins-hbase4:45019] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:0;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:1;jenkins-hbase4:45019] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:0;jenkins-hbase4:44631] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:1;jenkins-hbase4:45019] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,833 DEBUG [RS:1;jenkins-hbase4:45019] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:03:56,840 INFO [RS:0;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,840 INFO [RS:0;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,840 INFO [RS:0;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,843 INFO [RS:1;jenkins-hbase4:45019] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,843 INFO [RS:1;jenkins-hbase4:45019] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,843 INFO [RS:1;jenkins-hbase4:45019] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,851 INFO [RS:0;jenkins-hbase4:44631] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:03:56,851 INFO [RS:0;jenkins-hbase4:44631] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44631,1676304236460-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,853 INFO [RS:1;jenkins-hbase4:45019] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:03:56,854 INFO [RS:1;jenkins-hbase4:45019] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45019,1676304236491-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:56,862 INFO [RS:0;jenkins-hbase4:44631] regionserver.Replication(203): jenkins-hbase4.apache.org,44631,1676304236460 started 2023-02-13 16:03:56,862 INFO [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44631,1676304236460, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44631, sessionid=0x1004e6ca92b0001 2023-02-13 16:03:56,862 DEBUG [RS:0;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:03:56,862 DEBUG [RS:0;jenkins-hbase4:44631] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:56,862 DEBUG [RS:0;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44631,1676304236460' 2023-02-13 16:03:56,862 DEBUG [RS:0;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:56,862 DEBUG [RS:0;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:56,863 DEBUG [RS:0;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:03:56,863 DEBUG [RS:0;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:03:56,863 DEBUG [RS:0;jenkins-hbase4:44631] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:56,863 DEBUG [RS:0;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44631,1676304236460' 2023-02-13 16:03:56,863 DEBUG [RS:0;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:56,863 DEBUG [RS:0;jenkins-hbase4:44631] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:56,863 DEBUG [RS:0;jenkins-hbase4:44631] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:03:56,863 INFO [RS:0;jenkins-hbase4:44631] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:03:56,863 INFO [RS:0;jenkins-hbase4:44631] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:03:56,864 INFO [RS:1;jenkins-hbase4:45019] regionserver.Replication(203): jenkins-hbase4.apache.org,45019,1676304236491 started 2023-02-13 16:03:56,864 INFO [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45019,1676304236491, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45019, sessionid=0x1004e6ca92b0002 2023-02-13 16:03:56,864 DEBUG [RS:1;jenkins-hbase4:45019] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:03:56,864 DEBUG [RS:1;jenkins-hbase4:45019] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:56,864 DEBUG [RS:1;jenkins-hbase4:45019] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45019,1676304236491' 2023-02-13 16:03:56,864 DEBUG [RS:1;jenkins-hbase4:45019] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:03:56,864 DEBUG [RS:1;jenkins-hbase4:45019] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:56,864 DEBUG [RS:1;jenkins-hbase4:45019] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:03:56,864 DEBUG [RS:1;jenkins-hbase4:45019] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:03:56,864 DEBUG [RS:1;jenkins-hbase4:45019] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:56,865 DEBUG [RS:1;jenkins-hbase4:45019] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45019,1676304236491' 2023-02-13 16:03:56,865 DEBUG [RS:1;jenkins-hbase4:45019] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:56,865 DEBUG [RS:1;jenkins-hbase4:45019] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:56,865 DEBUG [RS:1;jenkins-hbase4:45019] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:03:56,865 INFO [RS:1;jenkins-hbase4:45019] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:03:56,865 INFO [RS:1;jenkins-hbase4:45019] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:03:56,909 DEBUG [jenkins-hbase4:39489] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 16:03:56,909 DEBUG [jenkins-hbase4:39489] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:56,910 DEBUG [jenkins-hbase4:39489] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:56,910 DEBUG [jenkins-hbase4:39489] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:56,910 DEBUG [jenkins-hbase4:39489] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:56,911 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 16:03:56,911 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45019,1676304236491, state=OPENING 2023-02-13 16:03:56,913 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 16:03:56,914 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:56,915 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:03:56,915 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:03:57,069 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:57,069 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:03:57,071 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53934, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:03:57,075 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 16:03:57,075 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:03:57,077 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45019%2C1676304236491.meta, suffix=.meta, logDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/WALs/jenkins-hbase4.apache.org,45019,1676304236491, archiveDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/oldWALs, maxLogs=32 2023-02-13 16:03:57,090 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42309,DS-e6eb5970-aba4-4f5e-bcc2-eb7053a69fcb,DISK] 2023-02-13 16:03:57,093 DEBUG [RS-EventLoopGroup-14-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34139,DS-e9173e01-37ea-4b5e-bcb6-96307cbb5eed,DISK] 2023-02-13 16:03:57,095 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/WALs/jenkins-hbase4.apache.org,45019,1676304236491/jenkins-hbase4.apache.org%2C45019%2C1676304236491.meta.1676304237077.meta 2023-02-13 16:03:57,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42309,DS-e6eb5970-aba4-4f5e-bcc2-eb7053a69fcb,DISK], DatanodeInfoWithStorage[127.0.0.1:34139,DS-e9173e01-37ea-4b5e-bcb6-96307cbb5eed,DISK]] 2023-02-13 16:03:57,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:57,095 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 16:03:57,096 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 16:03:57,096 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 16:03:57,096 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 16:03:57,096 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,096 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 16:03:57,096 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 16:03:57,097 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:03:57,098 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/info 2023-02-13 16:03:57,098 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/info 2023-02-13 16:03:57,098 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:03:57,099 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:57,099 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:03:57,100 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:57,100 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:03:57,100 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:03:57,100 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:57,100 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:03:57,101 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/table 2023-02-13 16:03:57,101 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/table 2023-02-13 16:03:57,101 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:03:57,102 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:57,103 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740 2023-02-13 16:03:57,104 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740 2023-02-13 16:03:57,105 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:03:57,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:03:57,107 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65000336, jitterRate=-0.03141951560974121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:03:57,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676304237096Writing region info on filesystem at 1676304237096Initializing all the Stores at 1676304237097 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304237097Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304237097Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304237097Cleaning up temporary data from old regions at 1676304237104 (+7 ms)Cleaning up detritus from prior splits at 1676304237105 (+1 ms)Running coprocessor post-open hooks at 1676304237107 (+2 ms)Region opened successfully at 1676304237107 2023-02-13 16:03:57,108 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676304237069 2023-02-13 16:03:57,112 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 16:03:57,113 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 16:03:57,113 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45019,1676304236491, state=OPEN 2023-02-13 16:03:57,115 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 16:03:57,115 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:03:57,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 16:03:57,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45019,1676304236491 in 200 msec 2023-02-13 16:03:57,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 16:03:57,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 361 msec 2023-02-13 16:03:57,119 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 413 msec 2023-02-13 16:03:57,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676304236579, completionTime=-1 2023-02-13 16:03:57,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 16:03:57,119 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 16:03:57,123 DEBUG [hconnection-0xef40a4c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:57,124 INFO [RS-EventLoopGroup-14-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53946, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:57,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 16:03:57,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676304297125 2023-02-13 16:03:57,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676304357125 2023-02-13 16:03:57,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-13 16:03:57,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39489,1676304236409-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:57,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39489,1676304236409-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:57,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39489,1676304236409-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:57,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39489, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:57,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 16:03:57,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 16:03:57,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:57,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 16:03:57,132 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 16:03:57,133 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:03:57,133 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:03:57,135 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:03:57,135 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c empty. 2023-02-13 16:03:57,135 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:03:57,136 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 16:03:57,144 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:57,145 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => ed446ea485d34e750141848e0edd7d4c, NAME => 'hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing ed446ea485d34e750141848e0edd7d4c, disabling compactions & flushes 2023-02-13 16:03:57,155 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:03:57,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:03:57,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. after waiting 0 ms 2023-02-13 16:03:57,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:03:57,155 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:03:57,155 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for ed446ea485d34e750141848e0edd7d4c: Waiting for close lock at 1676304237155Disabling compacts and flushes for region at 1676304237155Disabling writes for close at 1676304237155Writing region close event to WAL at 1676304237155Closed at 1676304237155 2023-02-13 16:03:57,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:03:57,158 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304237158"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237158"}]},"ts":"1676304237158"} 2023-02-13 16:03:57,160 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:03:57,161 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:03:57,161 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304237161"}]},"ts":"1676304237161"} 2023-02-13 16:03:57,163 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 16:03:57,166 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:57,167 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:57,167 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:57,167 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:57,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ed446ea485d34e750141848e0edd7d4c, ASSIGN}] 2023-02-13 16:03:57,175 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ed446ea485d34e750141848e0edd7d4c, ASSIGN 2023-02-13 16:03:57,176 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ed446ea485d34e750141848e0edd7d4c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676304236460; forceNewPlan=false, retain=false 2023-02-13 16:03:57,326 INFO [jenkins-hbase4:39489] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:03:57,327 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ed446ea485d34e750141848e0edd7d4c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:57,327 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304237327"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237327"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237327"}]},"ts":"1676304237327"} 2023-02-13 16:03:57,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ed446ea485d34e750141848e0edd7d4c, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:03:57,482 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:57,483 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:03:57,484 INFO [RS-EventLoopGroup-13-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51972, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:03:57,488 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:03:57,489 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44631%2C1676304236460, suffix=, logDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/WALs/jenkins-hbase4.apache.org,44631,1676304236460, archiveDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/oldWALs, maxLogs=32 2023-02-13 16:03:57,504 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34139,DS-e9173e01-37ea-4b5e-bcb6-96307cbb5eed,DISK] 2023-02-13 16:03:57,504 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42309,DS-e6eb5970-aba4-4f5e-bcc2-eb7053a69fcb,DISK] 2023-02-13 16:03:57,509 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/WALs/jenkins-hbase4.apache.org,44631,1676304236460/jenkins-hbase4.apache.org%2C44631%2C1676304236460.1676304237489 2023-02-13 16:03:57,509 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42309,DS-e6eb5970-aba4-4f5e-bcc2-eb7053a69fcb,DISK], DatanodeInfoWithStorage[127.0.0.1:34139,DS-e9173e01-37ea-4b5e-bcb6-96307cbb5eed,DISK]] 2023-02-13 16:03:57,509 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ed446ea485d34e750141848e0edd7d4c, NAME => 'hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:03:57,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:03:57,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:03:57,510 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:03:57,511 INFO [StoreOpener-ed446ea485d34e750141848e0edd7d4c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:03:57,512 DEBUG [StoreOpener-ed446ea485d34e750141848e0edd7d4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c/info 2023-02-13 16:03:57,512 DEBUG [StoreOpener-ed446ea485d34e750141848e0edd7d4c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c/info 2023-02-13 16:03:57,513 INFO [StoreOpener-ed446ea485d34e750141848e0edd7d4c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed446ea485d34e750141848e0edd7d4c columnFamilyName info 2023-02-13 16:03:57,513 INFO [StoreOpener-ed446ea485d34e750141848e0edd7d4c-1] regionserver.HStore(310): Store=ed446ea485d34e750141848e0edd7d4c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:57,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:03:57,514 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:03:57,517 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:03:57,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:57,519 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened ed446ea485d34e750141848e0edd7d4c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71708803, jitterRate=0.0685444325208664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:03:57,519 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for ed446ea485d34e750141848e0edd7d4c: Running coprocessor pre-open hook at 1676304237510Writing region info on filesystem at 1676304237510Initializing all the Stores at 1676304237511 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304237511Cleaning up temporary data from old regions at 1676304237515 (+4 ms)Cleaning up detritus from prior splits at 1676304237515Running coprocessor post-open hooks at 1676304237519 (+4 ms)Region opened successfully at 1676304237519 2023-02-13 16:03:57,520 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c., pid=6, masterSystemTime=1676304237482 2023-02-13 16:03:57,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:03:57,524 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:03:57,525 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ed446ea485d34e750141848e0edd7d4c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:57,525 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304237525"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304237525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304237525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304237525"}]},"ts":"1676304237525"} 2023-02-13 16:03:57,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 16:03:57,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ed446ea485d34e750141848e0edd7d4c, server=jenkins-hbase4.apache.org,44631,1676304236460 in 197 msec 2023-02-13 16:03:57,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 16:03:57,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ed446ea485d34e750141848e0edd7d4c, ASSIGN in 360 msec 2023-02-13 16:03:57,530 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:03:57,530 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304237530"}]},"ts":"1676304237530"} 2023-02-13 16:03:57,531 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 16:03:57,533 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:03:57,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 16:03:57,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 402 msec 2023-02-13 16:03:57,535 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:57,535 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:03:57,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:57,538 INFO [RS-EventLoopGroup-13-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51974, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:57,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 16:03:57,551 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:57,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 14 msec 2023-02-13 16:03:57,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 16:03:57,568 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:03:57,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-13 16:03:57,576 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 16:03:57,578 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 16:03:57,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.993sec 2023-02-13 16:03:57,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 16:03:57,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 16:03:57,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 16:03:57,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39489,1676304236409-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 16:03:57,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39489,1676304236409-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 16:03:57,626 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 16:03:57,678 DEBUG [Listener at localhost/35815] zookeeper.ReadOnlyZKClient(139): Connect 0x410c54c0 to 127.0.0.1:62288 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:57,683 DEBUG [Listener at localhost/35815] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77960f59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:57,684 DEBUG [hconnection-0x7b67dd44-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:57,686 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53956, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:57,687 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39489,1676304236409 2023-02-13 16:03:57,688 DEBUG [Listener at localhost/35815] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 16:03:57,689 DEBUG [Listener at localhost/35815] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 16:03:57,691 INFO [RS-EventLoopGroup-12-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55166, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 16:03:57,692 INFO [Listener at localhost/35815] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-13 16:03:57,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-13 16:03:57,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 16:03:57,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:55166 deadline: 1676304297692, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceMultiRegion 2023-02-13 16:03:57,693 INFO [Listener at localhost/35815] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceMultiRegion' 2023-02-13 16:03:57,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:03:57,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:57,699 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:03:57,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceMultiRegion" procId is: 10 2023-02-13 16:03:57,699 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:03:57,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:57,707 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:03:57,707 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:03:57,707 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:03:57,707 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:03:57,707 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:03:57,707 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:03:57,707 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156 2023-02-13 16:03:57,707 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173 empty. 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3 empty. 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1 empty. 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897 empty. 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2 empty. 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359 empty. 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:03:57,708 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156 empty. 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719 empty. 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8 empty. 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003 empty. 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:03:57,709 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:03:57,710 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-13 16:03:57,718 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/.tabledesc/.tableinfo.0000000001 2023-02-13 16:03:57,719 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => d49c481402c6df23fd723c27097ad156, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,719 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => e48a3cd06e30e6169b9bc9b965f5a719, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,719 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => addfc8eb7c96bb556468ea56ec55a173, NAME => 'testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing e48a3cd06e30e6169b9bc9b965f5a719, disabling compactions & flushes 2023-02-13 16:03:57,726 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:57,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:57,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. after waiting 0 ms 2023-02-13 16:03:57,726 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:57,727 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:57,727 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for e48a3cd06e30e6169b9bc9b965f5a719: Waiting for close lock at 1676304237726Disabling compacts and flushes for region at 1676304237726Disabling writes for close at 1676304237726Writing region close event to WAL at 1676304237727 (+1 ms)Closed at 1676304237727 2023-02-13 16:03:57,727 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8646a3d3d530cc58099faa6abb729dd2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,728 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,728 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing addfc8eb7c96bb556468ea56ec55a173, disabling compactions & flushes 2023-02-13 16:03:57,728 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:57,728 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:57,728 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. after waiting 0 ms 2023-02-13 16:03:57,728 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:57,728 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:57,728 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for addfc8eb7c96bb556468ea56ec55a173: Waiting for close lock at 1676304237728Disabling compacts and flushes for region at 1676304237728Disabling writes for close at 1676304237728Writing region close event to WAL at 1676304237728Closed at 1676304237728 2023-02-13 16:03:57,729 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => 5823fbf2e700d0694fccfba5d8c7a6a1, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,729 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,729 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing d49c481402c6df23fd723c27097ad156, disabling compactions & flushes 2023-02-13 16:03:57,729 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:57,729 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:57,729 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. after waiting 0 ms 2023-02-13 16:03:57,729 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:57,729 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:57,730 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for d49c481402c6df23fd723c27097ad156: Waiting for close lock at 1676304237729Disabling compacts and flushes for region at 1676304237729Disabling writes for close at 1676304237729Writing region close event to WAL at 1676304237729Closed at 1676304237729 2023-02-13 16:03:57,730 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3e43fa2c94bcbf2834d8f3df44221897, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,738 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,738 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 8646a3d3d530cc58099faa6abb729dd2, disabling compactions & flushes 2023-02-13 16:03:57,738 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:57,738 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:57,738 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. after waiting 0 ms 2023-02-13 16:03:57,738 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:57,738 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:57,738 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 8646a3d3d530cc58099faa6abb729dd2: Waiting for close lock at 1676304237738Disabling compacts and flushes for region at 1676304237738Disabling writes for close at 1676304237738Writing region close event to WAL at 1676304237738Closed at 1676304237738 2023-02-13 16:03:57,739 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => 5ad9f94449126a32bbc91ae22c608359, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,740 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,740 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing 5823fbf2e700d0694fccfba5d8c7a6a1, disabling compactions & flushes 2023-02-13 16:03:57,740 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:03:57,740 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:03:57,740 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. after waiting 0 ms 2023-02-13 16:03:57,740 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:03:57,740 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:03:57,740 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for 5823fbf2e700d0694fccfba5d8c7a6a1: Waiting for close lock at 1676304237740Disabling compacts and flushes for region at 1676304237740Disabling writes for close at 1676304237740Writing region close event to WAL at 1676304237740Closed at 1676304237740 2023-02-13 16:03:57,740 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => e4c0a4179cf2b281d1840291f3c74db3, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,742 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 3e43fa2c94bcbf2834d8f3df44221897, disabling compactions & flushes 2023-02-13 16:03:57,742 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:57,743 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:57,743 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. after waiting 0 ms 2023-02-13 16:03:57,743 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:57,743 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:57,743 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 3e43fa2c94bcbf2834d8f3df44221897: Waiting for close lock at 1676304237742Disabling compacts and flushes for region at 1676304237742Disabling writes for close at 1676304237743 (+1 ms)Writing region close event to WAL at 1676304237743Closed at 1676304237743 2023-02-13 16:03:57,743 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4829240dd0e63b15968d87bd3e5fc003, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1603): Closing e4c0a4179cf2b281d1840291f3c74db3, disabling compactions & flushes 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing 5ad9f94449126a32bbc91ae22c608359, disabling compactions & flushes 2023-02-13 16:03:57,754 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:57,754 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. after waiting 0 ms 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:57,754 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. after waiting 0 ms 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for 5ad9f94449126a32bbc91ae22c608359: Waiting for close lock at 1676304237754Disabling compacts and flushes for region at 1676304237754Disabling writes for close at 1676304237754Writing region close event to WAL at 1676304237754Closed at 1676304237754 2023-02-13 16:03:57,754 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:57,755 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:57,755 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-0] regionserver.HRegion(1557): Region close journal for e4c0a4179cf2b281d1840291f3c74db3: Waiting for close lock at 1676304237754Disabling compacts and flushes for region at 1676304237754Disabling writes for close at 1676304237754Writing region close event to WAL at 1676304237755 (+1 ms)Closed at 1676304237755 2023-02-13 16:03:57,755 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(7671): creating {ENCODED => de2fe8e662905cab2bf9f0dcf34e33f8, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp 2023-02-13 16:03:57,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1603): Closing 4829240dd0e63b15968d87bd3e5fc003, disabling compactions & flushes 2023-02-13 16:03:57,756 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:57,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:57,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. after waiting 0 ms 2023-02-13 16:03:57,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:57,756 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:57,756 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-2] regionserver.HRegion(1557): Region close journal for 4829240dd0e63b15968d87bd3e5fc003: Waiting for close lock at 1676304237756Disabling compacts and flushes for region at 1676304237756Disabling writes for close at 1676304237756Writing region close event to WAL at 1676304237756Closed at 1676304237756 2023-02-13 16:03:57,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:57,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1603): Closing de2fe8e662905cab2bf9f0dcf34e33f8, disabling compactions & flushes 2023-02-13 16:03:57,763 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:57,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:57,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. after waiting 0 ms 2023-02-13 16:03:57,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:57,763 INFO [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:57,763 DEBUG [RegionOpenAndInit-testWithMockedMapReduceMultiRegion-pool-1] regionserver.HRegion(1557): Region close journal for de2fe8e662905cab2bf9f0dcf34e33f8: Waiting for close lock at 1676304237763Disabling compacts and flushes for region at 1676304237763Disabling writes for close at 1676304237763Writing region close event to WAL at 1676304237763Closed at 1676304237763 2023-02-13 16:03:57,765 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:03:57,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237765"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237765"}]},"ts":"1676304237765"} 2023-02-13 16:03:57,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676304237765"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237765"}]},"ts":"1676304237765"} 2023-02-13 16:03:57,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676304237695.d49c481402c6df23fd723c27097ad156.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237765"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237765"}]},"ts":"1676304237765"} 2023-02-13 16:03:57,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237765"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237765"}]},"ts":"1676304237765"} 2023-02-13 16:03:57,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237765"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237765"}]},"ts":"1676304237765"} 2023-02-13 16:03:57,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237765"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237765"}]},"ts":"1676304237765"} 2023-02-13 16:03:57,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237765"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237765"}]},"ts":"1676304237765"} 2023-02-13 16:03:57,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237765"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237765"}]},"ts":"1676304237765"} 2023-02-13 16:03:57,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237765"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237765"}]},"ts":"1676304237765"} 2023-02-13 16:03:57,766 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676304237765"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304237765"}]},"ts":"1676304237765"} 2023-02-13 16:03:57,768 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 10 regions to meta. 2023-02-13 16:03:57,768 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:03:57,769 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304237769"}]},"ts":"1676304237769"} 2023-02-13 16:03:57,770 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLING in hbase:meta 2023-02-13 16:03:57,773 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:03:57,778 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:03:57,778 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:03:57,778 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:03:57,779 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=addfc8eb7c96bb556468ea56ec55a173, ASSIGN}, {pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e48a3cd06e30e6169b9bc9b965f5a719, ASSIGN}, {pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d49c481402c6df23fd723c27097ad156, ASSIGN}, {pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8646a3d3d530cc58099faa6abb729dd2, ASSIGN}, {pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5823fbf2e700d0694fccfba5d8c7a6a1, ASSIGN}, {pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3e43fa2c94bcbf2834d8f3df44221897, ASSIGN}, {pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5ad9f94449126a32bbc91ae22c608359, ASSIGN}, {pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4c0a4179cf2b281d1840291f3c74db3, ASSIGN}, {pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4829240dd0e63b15968d87bd3e5fc003, ASSIGN}, {pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de2fe8e662905cab2bf9f0dcf34e33f8, ASSIGN}] 2023-02-13 16:03:57,780 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d49c481402c6df23fd723c27097ad156, ASSIGN 2023-02-13 16:03:57,780 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=addfc8eb7c96bb556468ea56ec55a173, ASSIGN 2023-02-13 16:03:57,781 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e48a3cd06e30e6169b9bc9b965f5a719, ASSIGN 2023-02-13 16:03:57,781 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8646a3d3d530cc58099faa6abb729dd2, ASSIGN 2023-02-13 16:03:57,781 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d49c481402c6df23fd723c27097ad156, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676304236460; forceNewPlan=false, retain=false 2023-02-13 16:03:57,781 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=addfc8eb7c96bb556468ea56ec55a173, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45019,1676304236491; forceNewPlan=false, retain=false 2023-02-13 16:03:57,781 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=12, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e48a3cd06e30e6169b9bc9b965f5a719, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676304236460; forceNewPlan=false, retain=false 2023-02-13 16:03:57,781 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8646a3d3d530cc58099faa6abb729dd2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45019,1676304236491; forceNewPlan=false, retain=false 2023-02-13 16:03:57,782 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de2fe8e662905cab2bf9f0dcf34e33f8, ASSIGN 2023-02-13 16:03:57,782 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4829240dd0e63b15968d87bd3e5fc003, ASSIGN 2023-02-13 16:03:57,782 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4c0a4179cf2b281d1840291f3c74db3, ASSIGN 2023-02-13 16:03:57,782 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5ad9f94449126a32bbc91ae22c608359, ASSIGN 2023-02-13 16:03:57,782 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3e43fa2c94bcbf2834d8f3df44221897, ASSIGN 2023-02-13 16:03:57,783 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de2fe8e662905cab2bf9f0dcf34e33f8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45019,1676304236491; forceNewPlan=false, retain=false 2023-02-13 16:03:57,783 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=18, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4c0a4179cf2b281d1840291f3c74db3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45019,1676304236491; forceNewPlan=false, retain=false 2023-02-13 16:03:57,783 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=17, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5ad9f94449126a32bbc91ae22c608359, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676304236460; forceNewPlan=false, retain=false 2023-02-13 16:03:57,783 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3e43fa2c94bcbf2834d8f3df44221897, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45019,1676304236491; forceNewPlan=false, retain=false 2023-02-13 16:03:57,783 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4829240dd0e63b15968d87bd3e5fc003, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676304236460; forceNewPlan=false, retain=false 2023-02-13 16:03:57,784 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5823fbf2e700d0694fccfba5d8c7a6a1, ASSIGN 2023-02-13 16:03:57,785 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5823fbf2e700d0694fccfba5d8c7a6a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44631,1676304236460; forceNewPlan=false, retain=false 2023-02-13 16:03:57,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:57,867 INFO [RS:1;jenkins-hbase4:45019] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45019%2C1676304236491, suffix=, logDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/WALs/jenkins-hbase4.apache.org,45019,1676304236491, archiveDir=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/oldWALs, maxLogs=32 2023-02-13 16:03:57,882 DEBUG [RS-EventLoopGroup-14-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42309,DS-e6eb5970-aba4-4f5e-bcc2-eb7053a69fcb,DISK] 2023-02-13 16:03:57,882 DEBUG [RS-EventLoopGroup-14-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34139,DS-e9173e01-37ea-4b5e-bcb6-96307cbb5eed,DISK] 2023-02-13 16:03:57,884 INFO [RS:1;jenkins-hbase4:45019] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/WALs/jenkins-hbase4.apache.org,45019,1676304236491/jenkins-hbase4.apache.org%2C45019%2C1676304236491.1676304237867 2023-02-13 16:03:57,884 DEBUG [RS:1;jenkins-hbase4:45019] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42309,DS-e6eb5970-aba4-4f5e-bcc2-eb7053a69fcb,DISK], DatanodeInfoWithStorage[127.0.0.1:34139,DS-e9173e01-37ea-4b5e-bcb6-96307cbb5eed,DISK]] 2023-02-13 16:03:57,931 INFO [jenkins-hbase4:39489] balancer.BaseLoadBalancer(1545): Reassigned 10 regions. 10 retained the pre-restart assignment. 2023-02-13 16:03:57,937 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e4c0a4179cf2b281d1840291f3c74db3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:57,937 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=de2fe8e662905cab2bf9f0dcf34e33f8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:57,937 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8646a3d3d530cc58099faa6abb729dd2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:57,937 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=addfc8eb7c96bb556468ea56ec55a173, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:57,938 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237937"}]},"ts":"1676304237937"} 2023-02-13 16:03:57,937 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3e43fa2c94bcbf2834d8f3df44221897, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:57,938 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676304237937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237937"}]},"ts":"1676304237937"} 2023-02-13 16:03:57,938 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237937"}]},"ts":"1676304237937"} 2023-02-13 16:03:57,938 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237937"}]},"ts":"1676304237937"} 2023-02-13 16:03:57,938 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676304237937"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237937"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237937"}]},"ts":"1676304237937"} 2023-02-13 16:03:57,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=14, state=RUNNABLE; OpenRegionProcedure 8646a3d3d530cc58099faa6abb729dd2, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:03:57,940 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=11, state=RUNNABLE; OpenRegionProcedure addfc8eb7c96bb556468ea56ec55a173, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:03:57,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=23, ppid=16, state=RUNNABLE; OpenRegionProcedure 3e43fa2c94bcbf2834d8f3df44221897, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:03:57,941 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=18, state=RUNNABLE; OpenRegionProcedure e4c0a4179cf2b281d1840291f3c74db3, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:03:57,942 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=20, state=RUNNABLE; OpenRegionProcedure de2fe8e662905cab2bf9f0dcf34e33f8, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:03:57,943 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e48a3cd06e30e6169b9bc9b965f5a719, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:57,943 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237943"}]},"ts":"1676304237943"} 2023-02-13 16:03:57,944 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d49c481402c6df23fd723c27097ad156, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:57,944 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676304237695.d49c481402c6df23fd723c27097ad156.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237943"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237943"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237943"}]},"ts":"1676304237943"} 2023-02-13 16:03:57,944 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=5ad9f94449126a32bbc91ae22c608359, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:57,944 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237944"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237944"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237944"}]},"ts":"1676304237944"} 2023-02-13 16:03:57,945 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4829240dd0e63b15968d87bd3e5fc003, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:57,945 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237945"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237945"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237945"}]},"ts":"1676304237945"} 2023-02-13 16:03:57,945 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=26, ppid=12, state=RUNNABLE; OpenRegionProcedure e48a3cd06e30e6169b9bc9b965f5a719, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:03:57,945 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=27, ppid=13, state=RUNNABLE; OpenRegionProcedure d49c481402c6df23fd723c27097ad156, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:03:57,946 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5823fbf2e700d0694fccfba5d8c7a6a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:57,946 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304237946"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304237946"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304237946"}]},"ts":"1676304237946"} 2023-02-13 16:03:57,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=17, state=RUNNABLE; OpenRegionProcedure 5ad9f94449126a32bbc91ae22c608359, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:03:57,947 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=29, ppid=19, state=RUNNABLE; OpenRegionProcedure 4829240dd0e63b15968d87bd3e5fc003, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:03:57,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=15, state=RUNNABLE; OpenRegionProcedure 5823fbf2e700d0694fccfba5d8c7a6a1, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:03:58,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:58,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:58,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e4c0a4179cf2b281d1840291f3c74db3, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.', STARTKEY => 't43', ENDKEY => 'wWV'} 2023-02-13 16:03:58,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:03:58,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:58,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:03:58,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:03:58,097 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:03:58,098 DEBUG [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1 2023-02-13 16:03:58,098 DEBUG [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1 2023-02-13 16:03:58,098 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4c0a4179cf2b281d1840291f3c74db3 columnFamilyName f1 2023-02-13 16:03:58,099 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] regionserver.HStore(310): Store=e4c0a4179cf2b281d1840291f3c74db3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,099 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:03:58,100 DEBUG [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2 2023-02-13 16:03:58,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:58,100 DEBUG [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2 2023-02-13 16:03:58,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4829240dd0e63b15968d87bd3e5fc003, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.', STARTKEY => 'wWV', ENDKEY => 'zz{'} 2023-02-13 16:03:58,100 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4c0a4179cf2b281d1840291f3c74db3 columnFamilyName f2 2023-02-13 16:03:58,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:03:58,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:58,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:03:58,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:03:58,101 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] regionserver.HStore(310): Store=e4c0a4179cf2b281d1840291f3c74db3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:03:58,102 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:03:58,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:03:58,103 DEBUG [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1 2023-02-13 16:03:58,103 DEBUG [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1 2023-02-13 16:03:58,103 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4829240dd0e63b15968d87bd3e5fc003 columnFamilyName f1 2023-02-13 16:03:58,103 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] regionserver.HStore(310): Store=4829240dd0e63b15968d87bd3e5fc003/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,103 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:03:58,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:58,104 DEBUG [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2 2023-02-13 16:03:58,104 DEBUG [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2 2023-02-13 16:03:58,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:03:58,105 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4829240dd0e63b15968d87bd3e5fc003 columnFamilyName f2 2023-02-13 16:03:58,105 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] regionserver.HStore(310): Store=4829240dd0e63b15968d87bd3e5fc003/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:03:58,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:03:58,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:58,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e4c0a4179cf2b281d1840291f3c74db3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62340306, jitterRate=-0.07105705142021179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:58,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e4c0a4179cf2b281d1840291f3c74db3: Running coprocessor pre-open hook at 1676304238096Writing region info on filesystem at 1676304238096Initializing all the Stores at 1676304238096Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238096Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238096Cleaning up temporary data from old regions at 1676304238103 (+7 ms)Cleaning up detritus from prior splits at 1676304238103Running coprocessor post-open hooks at 1676304238107 (+4 ms)Region opened successfully at 1676304238107 2023-02-13 16:03:58,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3., pid=24, masterSystemTime=1676304238091 2023-02-13 16:03:58,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:58,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:03:58,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:58,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:58,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:58,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => addfc8eb7c96bb556468ea56ec55a173, NAME => 'testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.', STARTKEY => '', ENDKEY => 'aaa'} 2023-02-13 16:03:58,110 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=18 updating hbase:meta row=e4c0a4179cf2b281d1840291f3c74db3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:03:58,110 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304238110"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304238110"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304238110"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304238110"}]},"ts":"1676304238110"} 2023-02-13 16:03:58,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:58,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:03:58,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:03:58,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:58,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 4829240dd0e63b15968d87bd3e5fc003; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72478341, jitterRate=0.08001144230365753}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:58,111 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:03:58,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 4829240dd0e63b15968d87bd3e5fc003: Running coprocessor pre-open hook at 1676304238101Writing region info on filesystem at 1676304238101Initializing all the Stores at 1676304238101Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238101Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238102 (+1 ms)Cleaning up temporary data from old regions at 1676304238107 (+5 ms)Cleaning up detritus from prior splits at 1676304238107Running coprocessor post-open hooks at 1676304238111 (+4 ms)Region opened successfully at 1676304238111 2023-02-13 16:03:58,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003., pid=29, masterSystemTime=1676304238097 2023-02-13 16:03:58,113 DEBUG [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/f1 2023-02-13 16:03:58,113 DEBUG [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/f1 2023-02-13 16:03:58,113 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region addfc8eb7c96bb556468ea56ec55a173 columnFamilyName f1 2023-02-13 16:03:58,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=18 2023-02-13 16:03:58,113 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=18, state=SUCCESS; OpenRegionProcedure e4c0a4179cf2b281d1840291f3c74db3, server=jenkins-hbase4.apache.org,45019,1676304236491 in 171 msec 2023-02-13 16:03:58,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:58,114 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] regionserver.HStore(310): Store=addfc8eb7c96bb556468ea56ec55a173/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:58,114 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:03:58,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:58,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d49c481402c6df23fd723c27097ad156, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'} 2023-02-13 16:03:58,114 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=4829240dd0e63b15968d87bd3e5fc003, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion d49c481402c6df23fd723c27097ad156 2023-02-13 16:03:58,114 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304238114"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304238114"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304238114"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304238114"}]},"ts":"1676304238114"} 2023-02-13 16:03:58,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:58,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d49c481402c6df23fd723c27097ad156 2023-02-13 16:03:58,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d49c481402c6df23fd723c27097ad156 2023-02-13 16:03:58,114 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4c0a4179cf2b281d1840291f3c74db3, ASSIGN in 335 msec 2023-02-13 16:03:58,115 DEBUG [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/f2 2023-02-13 16:03:58,115 DEBUG [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/f2 2023-02-13 16:03:58,115 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d49c481402c6df23fd723c27097ad156 2023-02-13 16:03:58,115 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region addfc8eb7c96bb556468ea56ec55a173 columnFamilyName f2 2023-02-13 16:03:58,116 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] regionserver.HStore(310): Store=addfc8eb7c96bb556468ea56ec55a173/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:03:58,117 DEBUG [StoreOpener-d49c481402c6df23fd723c27097ad156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1 2023-02-13 16:03:58,117 DEBUG [StoreOpener-d49c481402c6df23fd723c27097ad156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1 2023-02-13 16:03:58,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:03:58,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=19 2023-02-13 16:03:58,117 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=19, state=SUCCESS; OpenRegionProcedure 4829240dd0e63b15968d87bd3e5fc003, server=jenkins-hbase4.apache.org,44631,1676304236460 in 169 msec 2023-02-13 16:03:58,117 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d49c481402c6df23fd723c27097ad156 columnFamilyName f1 2023-02-13 16:03:58,117 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] regionserver.HStore(310): Store=d49c481402c6df23fd723c27097ad156/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,118 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d49c481402c6df23fd723c27097ad156 2023-02-13 16:03:58,118 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4829240dd0e63b15968d87bd3e5fc003, ASSIGN in 339 msec 2023-02-13 16:03:58,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:58,119 DEBUG [StoreOpener-d49c481402c6df23fd723c27097ad156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2 2023-02-13 16:03:58,119 DEBUG [StoreOpener-d49c481402c6df23fd723c27097ad156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2 2023-02-13 16:03:58,119 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d49c481402c6df23fd723c27097ad156 columnFamilyName f2 2023-02-13 16:03:58,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:03:58,120 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] regionserver.HStore(310): Store=d49c481402c6df23fd723c27097ad156/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156 2023-02-13 16:03:58,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156 2023-02-13 16:03:58,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:58,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened addfc8eb7c96bb556468ea56ec55a173; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71303297, jitterRate=0.062501922249794}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:58,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for addfc8eb7c96bb556468ea56ec55a173: Running coprocessor pre-open hook at 1676304238110Writing region info on filesystem at 1676304238110Initializing all the Stores at 1676304238111 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238111Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238111Cleaning up temporary data from old regions at 1676304238118 (+7 ms)Cleaning up detritus from prior splits at 1676304238118Running coprocessor post-open hooks at 1676304238122 (+4 ms)Region opened successfully at 1676304238122 2023-02-13 16:03:58,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:58,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173., pid=22, masterSystemTime=1676304238091 2023-02-13 16:03:58,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d49c481402c6df23fd723c27097ad156 2023-02-13 16:03:58,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:58,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:58,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:58,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8646a3d3d530cc58099faa6abb729dd2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'} 2023-02-13 16:03:58,124 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=addfc8eb7c96bb556468ea56ec55a173, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:03:58,124 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676304238124"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304238124"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304238124"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304238124"}]},"ts":"1676304238124"} 2023-02-13 16:03:58,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:58,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:03:58,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:03:58,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:58,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d49c481402c6df23fd723c27097ad156; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68610815, jitterRate=0.02238081395626068}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:58,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d49c481402c6df23fd723c27097ad156: Running coprocessor pre-open hook at 1676304238114Writing region info on filesystem at 1676304238114Initializing all the Stores at 1676304238115 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238115Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238115Cleaning up temporary data from old regions at 1676304238121 (+6 ms)Cleaning up detritus from prior splits at 1676304238121Running coprocessor post-open hooks at 1676304238126 (+5 ms)Region opened successfully at 1676304238126 2023-02-13 16:03:58,126 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 16:03:58,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156., pid=27, masterSystemTime=1676304238097 2023-02-13 16:03:58,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=11 2023-02-13 16:03:58,128 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=11, state=SUCCESS; OpenRegionProcedure addfc8eb7c96bb556468ea56ec55a173, server=jenkins-hbase4.apache.org,45019,1676304236491 in 186 msec 2023-02-13 16:03:58,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:58,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:58,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:03:58,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5823fbf2e700d0694fccfba5d8c7a6a1, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'} 2023-02-13 16:03:58,128 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=d49c481402c6df23fd723c27097ad156, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:03:58,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:58,128 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676304237695.d49c481402c6df23fd723c27097ad156.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304238128"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304238128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304238128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304238128"}]},"ts":"1676304238128"} 2023-02-13 16:03:58,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:03:58,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:03:58,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=addfc8eb7c96bb556468ea56ec55a173, ASSIGN in 350 msec 2023-02-13 16:03:58,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=27, resume processing ppid=13 2023-02-13 16:03:58,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, ppid=13, state=SUCCESS; OpenRegionProcedure d49c481402c6df23fd723c27097ad156, server=jenkins-hbase4.apache.org,44631,1676304236460 in 185 msec 2023-02-13 16:03:58,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d49c481402c6df23fd723c27097ad156, ASSIGN in 353 msec 2023-02-13 16:03:58,132 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:03:58,132 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:03:58,133 DEBUG [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1 2023-02-13 16:03:58,133 DEBUG [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1 2023-02-13 16:03:58,133 DEBUG [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1 2023-02-13 16:03:58,133 DEBUG [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1 2023-02-13 16:03:58,134 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5823fbf2e700d0694fccfba5d8c7a6a1 columnFamilyName f1 2023-02-13 16:03:58,134 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8646a3d3d530cc58099faa6abb729dd2 columnFamilyName f1 2023-02-13 16:03:58,135 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] regionserver.HStore(310): Store=8646a3d3d530cc58099faa6abb729dd2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,135 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] regionserver.HStore(310): Store=5823fbf2e700d0694fccfba5d8c7a6a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,135 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:03:58,135 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:03:58,136 DEBUG [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2 2023-02-13 16:03:58,136 DEBUG [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2 2023-02-13 16:03:58,136 DEBUG [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2 2023-02-13 16:03:58,136 DEBUG [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2 2023-02-13 16:03:58,137 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8646a3d3d530cc58099faa6abb729dd2 columnFamilyName f2 2023-02-13 16:03:58,137 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5823fbf2e700d0694fccfba5d8c7a6a1 columnFamilyName f2 2023-02-13 16:03:58,137 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] regionserver.HStore(310): Store=8646a3d3d530cc58099faa6abb729dd2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,137 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] regionserver.HStore(310): Store=5823fbf2e700d0694fccfba5d8c7a6a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:03:58,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:03:58,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:03:58,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:03:58,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:58,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:58,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:03:58,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:03:58,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:58,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:58,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 8646a3d3d530cc58099faa6abb729dd2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74940678, jitterRate=0.11670312285423279}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:58,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5823fbf2e700d0694fccfba5d8c7a6a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63761139, jitterRate=-0.049884989857673645}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:58,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 8646a3d3d530cc58099faa6abb729dd2: Running coprocessor pre-open hook at 1676304238125Writing region info on filesystem at 1676304238125Initializing all the Stores at 1676304238126 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238126Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238132 (+6 ms)Cleaning up temporary data from old regions at 1676304238139 (+7 ms)Cleaning up detritus from prior splits at 1676304238139Running coprocessor post-open hooks at 1676304238151 (+12 ms)Region opened successfully at 1676304238151 2023-02-13 16:03:58,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5823fbf2e700d0694fccfba5d8c7a6a1: Running coprocessor pre-open hook at 1676304238129Writing region info on filesystem at 1676304238129Initializing all the Stores at 1676304238129Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238130 (+1 ms)Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238132 (+2 ms)Cleaning up temporary data from old regions at 1676304238139 (+7 ms)Cleaning up detritus from prior splits at 1676304238139Running coprocessor post-open hooks at 1676304238151 (+12 ms)Region opened successfully at 1676304238151 2023-02-13 16:03:58,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1., pid=30, masterSystemTime=1676304238097 2023-02-13 16:03:58,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2., pid=21, masterSystemTime=1676304238091 2023-02-13 16:03:58,154 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8646a3d3d530cc58099faa6abb729dd2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,154 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304238154"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304238154"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304238154"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304238154"}]},"ts":"1676304238154"} 2023-02-13 16:03:58,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:58,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:58,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:58,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3e43fa2c94bcbf2834d8f3df44221897, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'} 2023-02-13 16:03:58,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:03:58,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:03:58,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:03:58,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:58,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:58,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e48a3cd06e30e6169b9bc9b965f5a719, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'} 2023-02-13 16:03:58,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:03:58,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:58,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:03:58,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:03:58,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:03:58,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:03:58,157 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5823fbf2e700d0694fccfba5d8c7a6a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,157 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:03:58,157 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:03:58,157 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304238157"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304238157"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304238157"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304238157"}]},"ts":"1676304238157"} 2023-02-13 16:03:58,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=14 2023-02-13 16:03:58,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=14, state=SUCCESS; OpenRegionProcedure 8646a3d3d530cc58099faa6abb729dd2, server=jenkins-hbase4.apache.org,45019,1676304236491 in 217 msec 2023-02-13 16:03:58,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8646a3d3d530cc58099faa6abb729dd2, ASSIGN in 381 msec 2023-02-13 16:03:58,162 DEBUG [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1 2023-02-13 16:03:58,162 DEBUG [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1 2023-02-13 16:03:58,162 DEBUG [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1 2023-02-13 16:03:58,162 DEBUG [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1 2023-02-13 16:03:58,162 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e43fa2c94bcbf2834d8f3df44221897 columnFamilyName f1 2023-02-13 16:03:58,163 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e48a3cd06e30e6169b9bc9b965f5a719 columnFamilyName f1 2023-02-13 16:03:58,163 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] regionserver.HStore(310): Store=3e43fa2c94bcbf2834d8f3df44221897/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,163 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:03:58,163 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] regionserver.HStore(310): Store=e48a3cd06e30e6169b9bc9b965f5a719/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,163 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:03:58,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=15 2023-02-13 16:03:58,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=15, state=SUCCESS; OpenRegionProcedure 5823fbf2e700d0694fccfba5d8c7a6a1, server=jenkins-hbase4.apache.org,44631,1676304236460 in 213 msec 2023-02-13 16:03:58,165 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5823fbf2e700d0694fccfba5d8c7a6a1, ASSIGN in 385 msec 2023-02-13 16:03:58,165 DEBUG [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2 2023-02-13 16:03:58,165 DEBUG [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2 2023-02-13 16:03:58,165 DEBUG [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2 2023-02-13 16:03:58,165 DEBUG [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2 2023-02-13 16:03:58,165 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e48a3cd06e30e6169b9bc9b965f5a719 columnFamilyName f2 2023-02-13 16:03:58,165 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e43fa2c94bcbf2834d8f3df44221897 columnFamilyName f2 2023-02-13 16:03:58,166 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] regionserver.HStore(310): Store=e48a3cd06e30e6169b9bc9b965f5a719/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,166 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] regionserver.HStore(310): Store=3e43fa2c94bcbf2834d8f3df44221897/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:03:58,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:03:58,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:03:58,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:03:58,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:58,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:58,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:03:58,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:03:58,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:58,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 3e43fa2c94bcbf2834d8f3df44221897; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74076529, jitterRate=0.10382629930973053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:58,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 3e43fa2c94bcbf2834d8f3df44221897: Running coprocessor pre-open hook at 1676304238156Writing region info on filesystem at 1676304238156Initializing all the Stores at 1676304238157 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238157Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238157Cleaning up temporary data from old regions at 1676304238167 (+10 ms)Cleaning up detritus from prior splits at 1676304238167Running coprocessor post-open hooks at 1676304238177 (+10 ms)Region opened successfully at 1676304238177 2023-02-13 16:03:58,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897., pid=23, masterSystemTime=1676304238091 2023-02-13 16:03:58,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:58,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened e48a3cd06e30e6169b9bc9b965f5a719; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65466268, jitterRate=-0.024476587772369385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:58,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for e48a3cd06e30e6169b9bc9b965f5a719: Running coprocessor pre-open hook at 1676304238156Writing region info on filesystem at 1676304238156Initializing all the Stores at 1676304238157 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238157Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238157Cleaning up temporary data from old regions at 1676304238167 (+10 ms)Cleaning up detritus from prior splits at 1676304238167Running coprocessor post-open hooks at 1676304238179 (+12 ms)Region opened successfully at 1676304238179 2023-02-13 16:03:58,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719., pid=26, masterSystemTime=1676304238097 2023-02-13 16:03:58,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:58,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:58,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:58,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => de2fe8e662905cab2bf9f0dcf34e33f8, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.', STARTKEY => 'zz{', ENDKEY => ''} 2023-02-13 16:03:58,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:03:58,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:58,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:03:58,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:03:58,182 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=3e43fa2c94bcbf2834d8f3df44221897, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:58,182 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304238181"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304238181"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304238181"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304238181"}]},"ts":"1676304238181"} 2023-02-13 16:03:58,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:58,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:58,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5ad9f94449126a32bbc91ae22c608359, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'} 2023-02-13 16:03:58,182 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:03:58,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceMultiRegion 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:03:58,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:03:58,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:03:58,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:03:58,183 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=12 updating hbase:meta row=e48a3cd06e30e6169b9bc9b965f5a719, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,183 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304238183"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304238183"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304238183"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304238183"}]},"ts":"1676304238183"} 2023-02-13 16:03:58,184 DEBUG [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/f1 2023-02-13 16:03:58,184 DEBUG [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/f1 2023-02-13 16:03:58,184 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de2fe8e662905cab2bf9f0dcf34e33f8 columnFamilyName f1 2023-02-13 16:03:58,185 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] regionserver.HStore(310): Store=de2fe8e662905cab2bf9f0dcf34e33f8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,185 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:03:58,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=16 2023-02-13 16:03:58,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=16, state=SUCCESS; OpenRegionProcedure 3e43fa2c94bcbf2834d8f3df44221897, server=jenkins-hbase4.apache.org,45019,1676304236491 in 242 msec 2023-02-13 16:03:58,188 DEBUG [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/f2 2023-02-13 16:03:58,188 DEBUG [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/f2 2023-02-13 16:03:58,188 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:03:58,188 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de2fe8e662905cab2bf9f0dcf34e33f8 columnFamilyName f2 2023-02-13 16:03:58,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=26, resume processing ppid=12 2023-02-13 16:03:58,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, ppid=12, state=SUCCESS; OpenRegionProcedure e48a3cd06e30e6169b9bc9b965f5a719, server=jenkins-hbase4.apache.org,44631,1676304236460 in 240 msec 2023-02-13 16:03:58,189 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] regionserver.HStore(310): Store=de2fe8e662905cab2bf9f0dcf34e33f8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e48a3cd06e30e6169b9bc9b965f5a719, ASSIGN in 410 msec 2023-02-13 16:03:58,190 DEBUG [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1 2023-02-13 16:03:58,190 DEBUG [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1 2023-02-13 16:03:58,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:03:58,190 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ad9f94449126a32bbc91ae22c608359 columnFamilyName f1 2023-02-13 16:03:58,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:03:58,191 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] regionserver.HStore(310): Store=5ad9f94449126a32bbc91ae22c608359/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,191 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:03:58,192 DEBUG [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2 2023-02-13 16:03:58,192 DEBUG [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2 2023-02-13 16:03:58,193 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ad9f94449126a32bbc91ae22c608359 columnFamilyName f2 2023-02-13 16:03:58,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:58,194 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] regionserver.HStore(310): Store=5ad9f94449126a32bbc91ae22c608359/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:03:58,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:03:58,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:03:58,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:03:58,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:03:58,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:03:58,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:58,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3e43fa2c94bcbf2834d8f3df44221897, ASSIGN in 408 msec 2023-02-13 16:03:58,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened de2fe8e662905cab2bf9f0dcf34e33f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63217814, jitterRate=-0.05798116326332092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:58,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for de2fe8e662905cab2bf9f0dcf34e33f8: Running coprocessor pre-open hook at 1676304238181Writing region info on filesystem at 1676304238181Initializing all the Stores at 1676304238182 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238182Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238182Cleaning up temporary data from old regions at 1676304238192 (+10 ms)Cleaning up detritus from prior splits at 1676304238192Running coprocessor post-open hooks at 1676304238199 (+7 ms)Region opened successfully at 1676304238199 2023-02-13 16:03:58,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8., pid=25, masterSystemTime=1676304238091 2023-02-13 16:03:58,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:58,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:58,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:03:58,202 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=de2fe8e662905cab2bf9f0dcf34e33f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,202 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676304238202"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304238202"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304238202"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304238202"}]},"ts":"1676304238202"} 2023-02-13 16:03:58,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 5ad9f94449126a32bbc91ae22c608359; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60283202, jitterRate=-0.10171028971672058}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:03:58,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 5ad9f94449126a32bbc91ae22c608359: Running coprocessor pre-open hook at 1676304238183Writing region info on filesystem at 1676304238183Initializing all the Stores at 1676304238183Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238183Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304238184 (+1 ms)Cleaning up temporary data from old regions at 1676304238196 (+12 ms)Cleaning up detritus from prior splits at 1676304238196Running coprocessor post-open hooks at 1676304238203 (+7 ms)Region opened successfully at 1676304238203 2023-02-13 16:03:58,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359., pid=28, masterSystemTime=1676304238097 2023-02-13 16:03:58,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:58,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:58,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=17 updating hbase:meta row=5ad9f94449126a32bbc91ae22c608359, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304238206"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304238206"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304238206"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304238206"}]},"ts":"1676304238206"} 2023-02-13 16:03:58,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=20 2023-02-13 16:03:58,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=20, state=SUCCESS; OpenRegionProcedure de2fe8e662905cab2bf9f0dcf34e33f8, server=jenkins-hbase4.apache.org,45019,1676304236491 in 262 msec 2023-02-13 16:03:58,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de2fe8e662905cab2bf9f0dcf34e33f8, ASSIGN in 429 msec 2023-02-13 16:03:58,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=17 2023-02-13 16:03:58,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=17, state=SUCCESS; OpenRegionProcedure 5ad9f94449126a32bbc91ae22c608359, server=jenkins-hbase4.apache.org,44631,1676304236460 in 261 msec 2023-02-13 16:03:58,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=10 2023-02-13 16:03:58,212 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5ad9f94449126a32bbc91ae22c608359, ASSIGN in 431 msec 2023-02-13 16:03:58,212 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:03:58,213 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304238212"}]},"ts":"1676304238212"} 2023-02-13 16:03:58,214 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=ENABLED in hbase:meta 2023-02-13 16:03:58,216 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceMultiRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:03:58,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceMultiRegion in 520 msec 2023-02-13 16:03:58,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:03:58,304 INFO [Listener at localhost/35815] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 10 completed 2023-02-13 16:03:58,305 DEBUG [Listener at localhost/35815] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceMultiRegion get assigned. Timeout = 60000ms 2023-02-13 16:03:58,305 INFO [Listener at localhost/35815] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:03:58,307 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceMultiRegion assigned to meta. Checking AM states. 2023-02-13 16:03:58,307 INFO [Listener at localhost/35815] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:03:58,307 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceMultiRegion assigned. 2023-02-13 16:03:58,307 INFO [Listener at localhost/35815] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 16:03:58,338 DEBUG [hconnection-0x7b67dd44-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:58,347 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:58,350 INFO [RS-EventLoopGroup-13-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:58,358 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44631] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:58,430 INFO [Listener at localhost/35815] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 16:03:58,430 INFO [Listener at localhost/35815] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 16:03:58,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 16:03:58,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676304238431 (current time:1676304238431). 2023-02-13 16:03:58,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 16:03:58,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] zookeeper.ReadOnlyZKClient(139): Connect 0x253d7c61 to 127.0.0.1:62288 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:03:58,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b438823, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:03:58,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:03:58,439 INFO [RS-EventLoopGroup-14-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:03:58,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x253d7c61 to 127.0.0.1:62288 2023-02-13 16:03:58,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:03:58,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 16:03:58,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 16:03:58,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] procedure2.ProcedureExecutor(1029): Stored pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 16:03:58,443 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=31, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 16:03:58,443 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=31, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676304838443 2023-02-13 16:03:58,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } 2023-02-13 16:03:58,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,444 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 16:03:58,444 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 16:03:58,445 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=31, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE 2023-02-13 16:03:58,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 16:03:58,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=EXCLUSIVE in 4 msec 2023-02-13 16:03:58,446 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 16:03:58,447 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED; timeout=600000, timestamp=1676304838447 2023-02-13 16:03:58,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,460 INFO [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-13 16:03:58,460 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:58,461 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-13 16:03:58,461 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 16:03:58,461 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,461 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,462 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:58,462 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:58,462 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:58,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:58,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:58,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:58,463 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,463 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,463 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,463 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:03:58,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-13 16:03:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 89 2023-02-13 16:03:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,464 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-13 16:03:58,464 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceMultiRegion from table testWithMockedMapReduceMultiRegion type FLUSH 2023-02-13 16:03:58,464 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,464 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,464 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-13 16:03:58,464 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:58,470 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 16:03:58,470 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 16:03:58,470 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 300000ms 2023-02-13 16:03:58,470 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:03:58,470 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44631,1676304236460' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 16:03:58,470 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 16:03:58,470 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 16:03:58,470 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45019,1676304236491' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 16:03:58,471 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,471 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,471 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,471 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:58,471 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,471 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:58,471 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,471 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:58,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:58,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:58,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:58,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45019,1676304236491' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 16:03:58,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@122e259d[Count = 1] remaining members to acquire global barrier 2023-02-13 16:03:58,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:58,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:58,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:58,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:58,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:58,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44631,1676304236460' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 16:03:58,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@122e259d[Count = 0] remaining members to acquire global barrier 2023-02-13 16:03:58,475 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 16:03:58,475 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,476 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,476 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 16:03:58,476 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,476 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:58,476 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. started... 2023-02-13 16:03:58,476 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,476 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:03:58,478 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,480 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 16:03:58,480 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 8646a3d3d530cc58099faa6abb729dd2 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:58,480 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 16:03:58,481 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:58,480 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:58,481 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:58,481 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. started... 2023-02-13 16:03:58,481 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. started... 2023-02-13 16:03:58,481 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. started... 2023-02-13 16:03:58,481 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 16:03:58,483 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 3e43fa2c94bcbf2834d8f3df44221897 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:58,483 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:58,483 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 5 regions 2023-02-13 16:03:58,481 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] regionserver.HRegion(2744): Flushing e4c0a4179cf2b281d1840291f3c74db3 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:58,481 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 4829240dd0e63b15968d87bd3e5fc003 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 16:03:58,481 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:03:58,483 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 16:03:58,483 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. started... 2023-02-13 16:03:58,484 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. started... 2023-02-13 16:03:58,486 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] regionserver.HRegion(2744): Flushing 5823fbf2e700d0694fccfba5d8c7a6a1 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:58,486 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HRegion(2744): Flushing 5ad9f94449126a32bbc91ae22c608359 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:58,514 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/.tmp/f1/92bd3c66608b4081b1773d604e6f4c84 2023-02-13 16:03:58,520 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/.tmp/f1/4b2cbc3fa8bb4f32bf9fd6278dae1b03 2023-02-13 16:03:58,520 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/.tmp/f1/64e8681caa6c454493aa938dea17d981 2023-02-13 16:03:58,536 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/.tmp/f1/e47e809b3bc54d1f852df0979fc57464 2023-02-13 16:03:58,536 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/.tmp/f1/8762baf641ec44a8a20c5016de367b22 2023-02-13 16:03:58,544 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:58,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 16:03:58,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:58,548 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 16:03:58,551 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/.tmp/f1/87bb14b94a4b43e88a1074e5cac33f2b 2023-02-13 16:03:58,565 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/.tmp/f2/41d66ca00e0f4b32859d84054a34b629 2023-02-13 16:03:58,565 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/.tmp/f2/4e30134099ed49af9daa9f06b6a8b98f 2023-02-13 16:03:58,571 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/.tmp/f1/92bd3c66608b4081b1773d604e6f4c84 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/92bd3c66608b4081b1773d604e6f4c84 2023-02-13 16:03:58,577 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/.tmp/f1/4b2cbc3fa8bb4f32bf9fd6278dae1b03 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/4b2cbc3fa8bb4f32bf9fd6278dae1b03 2023-02-13 16:03:58,578 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/92bd3c66608b4081b1773d604e6f4c84, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,579 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/.tmp/f2/41d66ca00e0f4b32859d84054a34b629 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/41d66ca00e0f4b32859d84054a34b629 2023-02-13 16:03:58,592 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/.tmp/f2/279a84e4cdcf4ffb9651a5cb33ad0654 2023-02-13 16:03:58,597 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/.tmp/f1/64e8681caa6c454493aa938dea17d981 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/64e8681caa6c454493aa938dea17d981 2023-02-13 16:03:58,600 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/4b2cbc3fa8bb4f32bf9fd6278dae1b03, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:58,601 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/41d66ca00e0f4b32859d84054a34b629, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,601 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/.tmp/f2/4e30134099ed49af9daa9f06b6a8b98f as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/4e30134099ed49af9daa9f06b6a8b98f 2023-02-13 16:03:58,602 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 8646a3d3d530cc58099faa6abb729dd2 in 122ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:58,602 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceMultiRegion' 2023-02-13 16:03:58,603 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 8646a3d3d530cc58099faa6abb729dd2: 2023-02-13 16:03:58,603 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,609 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:58,609 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/92bd3c66608b4081b1773d604e6f4c84] hfiles 2023-02-13 16:03:58,609 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/92bd3c66608b4081b1773d604e6f4c84 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,609 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/41d66ca00e0f4b32859d84054a34b629] hfiles 2023-02-13 16:03:58,609 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/41d66ca00e0f4b32859d84054a34b629 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,610 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/64e8681caa6c454493aa938dea17d981, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,610 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/.tmp/f2/8e11957abdbe4ac4be4b022f5245a16e 2023-02-13 16:03:58,611 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/.tmp/f2/279a84e4cdcf4ffb9651a5cb33ad0654 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/279a84e4cdcf4ffb9651a5cb33ad0654 2023-02-13 16:03:58,614 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/4e30134099ed49af9daa9f06b6a8b98f, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:58,615 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for 4829240dd0e63b15968d87bd3e5fc003 in 134ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:58,617 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 4829240dd0e63b15968d87bd3e5fc003: 2023-02-13 16:03:58,617 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,619 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/279a84e4cdcf4ffb9651a5cb33ad0654, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,619 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 3e43fa2c94bcbf2834d8f3df44221897 in 136ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:58,619 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 3e43fa2c94bcbf2834d8f3df44221897: 2023-02-13 16:03:58,620 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,620 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:58,620 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/64e8681caa6c454493aa938dea17d981] hfiles 2023-02-13 16:03:58,620 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/64e8681caa6c454493aa938dea17d981 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,620 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/279a84e4cdcf4ffb9651a5cb33ad0654] hfiles 2023-02-13 16:03:58,620 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/279a84e4cdcf4ffb9651a5cb33ad0654 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,621 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:58,621 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/4b2cbc3fa8bb4f32bf9fd6278dae1b03] hfiles 2023-02-13 16:03:58,621 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/4b2cbc3fa8bb4f32bf9fd6278dae1b03 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,621 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/4e30134099ed49af9daa9f06b6a8b98f] hfiles 2023-02-13 16:03:58,621 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/4e30134099ed49af9daa9f06b6a8b98f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,622 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/.tmp/f2/482510d1461843a9a9b5dc87172c9c97 2023-02-13 16:03:58,625 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/.tmp/f1/8762baf641ec44a8a20c5016de367b22 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/8762baf641ec44a8a20c5016de367b22 2023-02-13 16:03:58,626 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/.tmp/f2/c0ac1c35e7dd409795a56ad35a360b76 2023-02-13 16:03:58,629 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/.tmp/f1/e47e809b3bc54d1f852df0979fc57464 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/e47e809b3bc54d1f852df0979fc57464 2023-02-13 16:03:58,631 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/.tmp/f1/87bb14b94a4b43e88a1074e5cac33f2b as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/87bb14b94a4b43e88a1074e5cac33f2b 2023-02-13 16:03:58,634 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/e47e809b3bc54d1f852df0979fc57464, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,635 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/.tmp/f2/482510d1461843a9a9b5dc87172c9c97 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/482510d1461843a9a9b5dc87172c9c97 2023-02-13 16:03:58,636 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. completed. 2023-02-13 16:03:58,636 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:58,636 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:58,636 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 16:03:58,636 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. started... 2023-02-13 16:03:58,641 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HRegion(2744): Flushing e48a3cd06e30e6169b9bc9b965f5a719 2/2 column families, dataSize=158.44 KB heapSize=549.75 KB 2023-02-13 16:03:58,643 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/87bb14b94a4b43e88a1074e5cac33f2b, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,643 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/8762baf641ec44a8a20c5016de367b22, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,645 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/.tmp/f2/c0ac1c35e7dd409795a56ad35a360b76 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/c0ac1c35e7dd409795a56ad35a360b76 2023-02-13 16:03:58,645 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/.tmp/f2/8e11957abdbe4ac4be4b022f5245a16e as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/8e11957abdbe4ac4be4b022f5245a16e 2023-02-13 16:03:58,649 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. completed. 2023-02-13 16:03:58,649 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:58,649 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:58,649 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/5 local region snapshots. 2023-02-13 16:03:58,649 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. started... 2023-02-13 16:03:58,650 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for de2fe8e662905cab2bf9f0dcf34e33f8: 2023-02-13 16:03:58,651 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,651 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:58,651 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:58,651 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:58,657 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/c0ac1c35e7dd409795a56ad35a360b76, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,658 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/482510d1461843a9a9b5dc87172c9c97, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,659 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for e4c0a4179cf2b281d1840291f3c74db3 in 178ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:58,659 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for e4c0a4179cf2b281d1840291f3c74db3: 2023-02-13 16:03:58,659 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,659 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:58,659 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/e47e809b3bc54d1f852df0979fc57464] hfiles 2023-02-13 16:03:58,659 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/e47e809b3bc54d1f852df0979fc57464 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,659 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/482510d1461843a9a9b5dc87172c9c97] hfiles 2023-02-13 16:03:58,660 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/482510d1461843a9a9b5dc87172c9c97 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,660 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5ad9f94449126a32bbc91ae22c608359 in 174ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:58,660 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 5ad9f94449126a32bbc91ae22c608359: 2023-02-13 16:03:58,660 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,660 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:58,660 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/87bb14b94a4b43e88a1074e5cac33f2b] hfiles 2023-02-13 16:03:58,660 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/87bb14b94a4b43e88a1074e5cac33f2b for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,660 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/c0ac1c35e7dd409795a56ad35a360b76] hfiles 2023-02-13 16:03:58,660 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/c0ac1c35e7dd409795a56ad35a360b76 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,661 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/8e11957abdbe4ac4be4b022f5245a16e, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,668 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. completed. 2023-02-13 16:03:58,668 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:58,668 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:58,668 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 16:03:58,668 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. started... 2023-02-13 16:03:58,670 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for addfc8eb7c96bb556468ea56ec55a173: 2023-02-13 16:03:58,670 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for 5823fbf2e700d0694fccfba5d8c7a6a1 in 185ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:58,670 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,670 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 5823fbf2e700d0694fccfba5d8c7a6a1: 2023-02-13 16:03:58,671 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,671 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:58,671 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/8762baf641ec44a8a20c5016de367b22] hfiles 2023-02-13 16:03:58,671 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/8762baf641ec44a8a20c5016de367b22 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,671 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/8e11957abdbe4ac4be4b022f5245a16e] hfiles 2023-02-13 16:03:58,671 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/8e11957abdbe4ac4be4b022f5245a16e for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,671 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:58,671 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:58,671 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-02-13 16:03:58,684 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/.tmp/f1/b0ee3425c7b64808bb1f5395ee211173 2023-02-13 16:03:58,685 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. completed. 2023-02-13 16:03:58,685 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:58,685 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 16:03:58,702 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. completed. 2023-02-13 16:03:58,702 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:58,702 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:58,702 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/5 local region snapshots. 2023-02-13 16:03:58,702 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. started... 2023-02-13 16:03:58,703 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HRegion(2744): Flushing d49c481402c6df23fd723c27097ad156 2/2 column families, dataSize=118.83 KB heapSize=412.44 KB 2023-02-13 16:03:58,717 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. completed. 2023-02-13 16:03:58,717 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:58,717 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 16:03:58,720 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. completed. 2023-02-13 16:03:58,720 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:58,721 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 16:03:58,721 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 16:03:58,721 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,721 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 16:03:58,721 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,45019,1676304236491' in zk 2023-02-13 16:03:58,724 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 16:03:58,724 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,724 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:58,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:58,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:58,724 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 16:03:58,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:58,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:58,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:58,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,45019,1676304236491': 2023-02-13 16:03:58,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45019,1676304236491' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 16:03:58,735 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/.tmp/f1/0405118835f340b8b62444cdaee73f0f 2023-02-13 16:03:58,736 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=79.22 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/.tmp/f2/1be7e12791994bfeac71865d982e7394 2023-02-13 16:03:58,748 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/.tmp/f1/b0ee3425c7b64808bb1f5395ee211173 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/b0ee3425c7b64808bb1f5395ee211173 2023-02-13 16:03:58,749 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:58,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 16:03:58,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:58,751 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-13 16:03:58,753 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/b0ee3425c7b64808bb1f5395ee211173, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:58,754 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/.tmp/f2/1be7e12791994bfeac71865d982e7394 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/1be7e12791994bfeac71865d982e7394 2023-02-13 16:03:58,759 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/1be7e12791994bfeac71865d982e7394, entries=2704, sequenceid=5, filesize=90.7 K 2023-02-13 16:03:58,759 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=59.41 KB at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/.tmp/f2/9ccb05b3b442436cb9ed9aa3f6839c82 2023-02-13 16:03:58,759 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~158.44 KB/162240, heapSize ~549.72 KB/562912, currentSize=0 B/0 for e48a3cd06e30e6169b9bc9b965f5a719 in 118ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:58,760 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for e48a3cd06e30e6169b9bc9b965f5a719: 2023-02-13 16:03:58,760 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,760 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:58,760 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/b0ee3425c7b64808bb1f5395ee211173] hfiles 2023-02-13 16:03:58,760 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/b0ee3425c7b64808bb1f5395ee211173 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,760 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/1be7e12791994bfeac71865d982e7394] hfiles 2023-02-13 16:03:58,760 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/1be7e12791994bfeac71865d982e7394 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,764 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/.tmp/f1/0405118835f340b8b62444cdaee73f0f as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/0405118835f340b8b62444cdaee73f0f 2023-02-13 16:03:58,767 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/0405118835f340b8b62444cdaee73f0f, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,768 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/.tmp/f2/9ccb05b3b442436cb9ed9aa3f6839c82 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/9ccb05b3b442436cb9ed9aa3f6839c82 2023-02-13 16:03:58,775 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/9ccb05b3b442436cb9ed9aa3f6839c82, entries=2028, sequenceid=5, filesize=70.1 K 2023-02-13 16:03:58,776 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. completed. 2023-02-13 16:03:58,776 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:58,776 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/5 local region snapshots. 2023-02-13 16:03:58,776 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~118.83 KB/121680, heapSize ~412.41 KB/422304, currentSize=0 B/0 for d49c481402c6df23fd723c27097ad156 in 73ms, sequenceid=5, compaction requested=false 2023-02-13 16:03:58,776 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for d49c481402c6df23fd723c27097ad156: 2023-02-13 16:03:58,777 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156.' region-info for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,777 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:03:58,777 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/0405118835f340b8b62444cdaee73f0f] hfiles 2023-02-13 16:03:58,777 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/0405118835f340b8b62444cdaee73f0f for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,777 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/9ccb05b3b442436cb9ed9aa3f6839c82] hfiles 2023-02-13 16:03:58,777 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/9ccb05b3b442436cb9ed9aa3f6839c82 for snapshot=testWithMockedMapReduceMultiRegion 2023-02-13 16:03:58,786 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. completed. 2023-02-13 16:03:58,786 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:58,786 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 4/5 local region snapshots. 2023-02-13 16:03:59,051 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:59,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 16:03:59,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:03:59,052 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-13 16:03:59,105 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. completed. 2023-02-13 16:03:59,105 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:03:59,105 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 5/5 local region snapshots. 2023-02-13 16:03:59,105 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 5 local region snapshots. 2023-02-13 16:03:59,105 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,105 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 16:03:59,105 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44631,1676304236460' in zk 2023-02-13 16:03:59,107 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 16:03:59,107 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,107 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:59,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:59,107 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 16:03:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:59,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:59,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44631,1676304236460': 2023-02-13 16:03:59,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44631,1676304236460' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 16:03:59,110 INFO [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-13 16:03:59,110 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:03:59,110 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:03:59,110 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,111 INFO [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 16:03:59,112 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,112 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,112 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:03:59,112 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:59,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,112 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:59,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:59,113 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:59,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,113 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:59,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,114 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:59,115 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,122 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:59,122 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,122 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:03:59,122 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:59,122 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:03:59,122 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:59,123 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,122 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:03:59,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,122 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:03:59,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:59,123 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:03:59,123 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,123 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,123 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,123 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,123 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:59,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:59,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:03:59,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:03:59,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.hbase-snapshot/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,175 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed 2023-02-13 16:03:59,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,175 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.hbase-snapshot/.tmp/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceMultiRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceMultiRegion at 1676304238443Consolidate snapshot: testWithMockedMapReduceMultiRegion at 1676304239123 (+680 ms)Loading Region manifests for testWithMockedMapReduceMultiRegion at 1676304239123Writing data manifest for testWithMockedMapReduceMultiRegion at 1676304239130 (+7 ms)Verifying snapshot: testWithMockedMapReduceMultiRegion at 1676304239145 (+15 ms)Snapshot testWithMockedMapReduceMultiRegion of table testWithMockedMapReduceMultiRegion completed at 1676304239175 (+30 ms) 2023-02-13 16:03:59,177 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED 2023-02-13 16:03:59,178 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceMultiRegion, type=SHARED in 733 msec 2023-02-13 16:03:59,553 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:03:59,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 } is done 2023-02-13 16:03:59,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceMultiRegion table=testWithMockedMapReduceMultiRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 16:03:59,555 INFO [Listener at localhost/35815] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 16:03:59,559 INFO [Listener at localhost/35815] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 16:03:59,591 INFO [Listener at localhost/35815] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 16:03:59,626 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45019] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 6084 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:59,635 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44631] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 11492 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:59,693 INFO [Listener at localhost/35815] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 16:03:59,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 16:03:59,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,701 INFO [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceMultiRegion' 2023-02-13 16:03:59,702 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:59,702 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' 2023-02-13 16:03:59,703 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceMultiRegion', kicking off acquire phase on members. 2023-02-13 16:03:59,703 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,703 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,704 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,704 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:59,704 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:03:59,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:59,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:03:59,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:59,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:03:59,705 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:03:59,705 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,705 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,705 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:03:59,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:03:59,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:03:59,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,706 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,706 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,706 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-13 16:03:59,706 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:59,706 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceMultiRegion' with timeout 60000ms 2023-02-13 16:03:59,707 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 16:03:59,707 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:03:59,708 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceMultiRegion' starting 'acquire' stage 2023-02-13 16:03:59,708 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:59,708 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. started... 2023-02-13 16:03:59,708 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:59,708 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:59,708 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:59,708 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:03:59,708 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. started... 2023-02-13 16:03:59,708 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. started... 2023-02-13 16:03:59,708 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8646a3d3d530cc58099faa6abb729dd2 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:59,708 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 5823fbf2e700d0694fccfba5d8c7a6a1 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:59,708 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 16:03:59,708 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 16:03:59,708 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing e4c0a4179cf2b281d1840291f3c74db3 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:59,708 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. started... 2023-02-13 16:03:59,708 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. started... 2023-02-13 16:03:59,708 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3e43fa2c94bcbf2834d8f3df44221897 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:59,708 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4829240dd0e63b15968d87bd3e5fc003 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 16:03:59,712 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 5 regions 2023-02-13 16:03:59,712 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 16:03:59,712 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:59,713 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. started... 2023-02-13 16:03:59,713 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5ad9f94449126a32bbc91ae22c608359 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:59,741 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/.tmp/f1/c4c10f1635124df6be24397eec786ae3 2023-02-13 16:03:59,741 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/.tmp/f1/fb698fea18d54ab6806cab5a373a2924 2023-02-13 16:03:59,744 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/.tmp/f1/5e4b73f376b24d00becd6f29ff8d857b 2023-02-13 16:03:59,744 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/.tmp/f1/c6558eca56cf474395621be195dc0a89 2023-02-13 16:03:59,748 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/.tmp/f1/e40c5ba4af0b4f04b08dbf71c09fc8d1 2023-02-13 16:03:59,798 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/.tmp/f2/df41183563574dfbaf3c9edae123c0ee 2023-02-13 16:03:59,801 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/.tmp/f2/30497ac32020422ba2405a46652ab2be 2023-02-13 16:03:59,801 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/.tmp/f2/1bfdd8d806f34532bbce98aa646d663f 2023-02-13 16:03:59,802 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/.tmp/f2/f985748a6ed04ab4b8211088782c2082 2023-02-13 16:03:59,804 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/.tmp/f2/f8a2172f07534b6dbafaf5559b558a5e 2023-02-13 16:03:59,805 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/.tmp/f1/e40c5ba4af0b4f04b08dbf71c09fc8d1 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/e40c5ba4af0b4f04b08dbf71c09fc8d1 2023-02-13 16:03:59,812 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/.tmp/f1/c6558eca56cf474395621be195dc0a89 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/c6558eca56cf474395621be195dc0a89 2023-02-13 16:03:59,813 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/.tmp/f1/5e4b73f376b24d00becd6f29ff8d857b as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/5e4b73f376b24d00becd6f29ff8d857b 2023-02-13 16:03:59,813 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/.tmp/f1/c4c10f1635124df6be24397eec786ae3 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/c4c10f1635124df6be24397eec786ae3 2023-02-13 16:03:59,814 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/e40c5ba4af0b4f04b08dbf71c09fc8d1, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:59,815 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/.tmp/f1/fb698fea18d54ab6806cab5a373a2924 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/fb698fea18d54ab6806cab5a373a2924 2023-02-13 16:03:59,815 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/.tmp/f2/df41183563574dfbaf3c9edae123c0ee as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/df41183563574dfbaf3c9edae123c0ee 2023-02-13 16:03:59,818 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/c6558eca56cf474395621be195dc0a89, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:59,819 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/5e4b73f376b24d00becd6f29ff8d857b, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:59,819 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/c4c10f1635124df6be24397eec786ae3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:59,819 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/.tmp/f2/1bfdd8d806f34532bbce98aa646d663f as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/1bfdd8d806f34532bbce98aa646d663f 2023-02-13 16:03:59,820 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/.tmp/f2/f985748a6ed04ab4b8211088782c2082 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/f985748a6ed04ab4b8211088782c2082 2023-02-13 16:03:59,820 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/.tmp/f2/30497ac32020422ba2405a46652ab2be as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/30497ac32020422ba2405a46652ab2be 2023-02-13 16:03:59,820 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/df41183563574dfbaf3c9edae123c0ee, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:59,821 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 3e43fa2c94bcbf2834d8f3df44221897 in 113ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:59,821 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3e43fa2c94bcbf2834d8f3df44221897: 2023-02-13 16:03:59,821 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:03:59,822 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:59,822 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/fb698fea18d54ab6806cab5a373a2924, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:59,822 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. started... 2023-02-13 16:03:59,822 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 16:03:59,822 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for de2fe8e662905cab2bf9f0dcf34e33f8: 2023-02-13 16:03:59,822 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:03:59,822 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 16:03:59,822 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:59,822 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. started... 2023-02-13 16:03:59,822 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for addfc8eb7c96bb556468ea56ec55a173: 2023-02-13 16:03:59,822 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:03:59,822 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 16:03:59,822 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/.tmp/f2/f8a2172f07534b6dbafaf5559b558a5e as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/f8a2172f07534b6dbafaf5559b558a5e 2023-02-13 16:03:59,825 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/1bfdd8d806f34532bbce98aa646d663f, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:59,826 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for 4829240dd0e63b15968d87bd3e5fc003 in 118ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:59,827 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4829240dd0e63b15968d87bd3e5fc003: 2023-02-13 16:03:59,827 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:03:59,828 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:59,828 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. started... 2023-02-13 16:03:59,828 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/5 local region flush tasks. 2023-02-13 16:03:59,828 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e48a3cd06e30e6169b9bc9b965f5a719 2/2 column families, dataSize=248.22 KB heapSize=634.25 KB 2023-02-13 16:03:59,828 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/f985748a6ed04ab4b8211088782c2082, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:59,829 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for e4c0a4179cf2b281d1840291f3c74db3 in 121ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:59,829 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for e4c0a4179cf2b281d1840291f3c74db3: 2023-02-13 16:03:59,829 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:03:59,829 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 16:03:59,835 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/30497ac32020422ba2405a46652ab2be, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:59,836 INFO [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 8646a3d3d530cc58099faa6abb729dd2 in 128ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:59,836 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8646a3d3d530cc58099faa6abb729dd2: 2023-02-13 16:03:59,836 DEBUG [rs(jenkins-hbase4.apache.org,45019,1676304236491)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:03:59,836 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 16:03:59,836 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 16:03:59,836 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,837 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 16:03:59,837 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45019,1676304236491' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 16:03:59,837 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/f8a2172f07534b6dbafaf5559b558a5e, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:59,838 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5ad9f94449126a32bbc91ae22c608359 in 125ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:59,838 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5ad9f94449126a32bbc91ae22c608359: 2023-02-13 16:03:59,838 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:03:59,838 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:59,838 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/5 local region flush tasks. 2023-02-13 16:03:59,838 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. started... 2023-02-13 16:03:59,838 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d49c481402c6df23fd723c27097ad156 2/2 column families, dataSize=186.16 KB heapSize=475.81 KB 2023-02-13 16:03:59,838 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,840 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:03:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:03:59,840 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,840 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:03:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:03:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:03:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:03:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:03:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:03:59,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45019,1676304236491' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 16:03:59,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1611b300[Count = 1] remaining members to acquire global barrier 2023-02-13 16:03:59,853 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/.tmp/f1/bc1af94d13e745719e68c0caf57e3fd0 2023-02-13 16:03:59,853 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/.tmp/f1/e1f5078546ff4bdb840190d21d194430 2023-02-13 16:03:59,865 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/.tmp/f2/099d7c2f082c49a59ab274fd7c32b65d 2023-02-13 16:03:59,867 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124.11 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/.tmp/f2/5d87d36613df4473872bf25579e0484a 2023-02-13 16:03:59,871 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/.tmp/f1/e1f5078546ff4bdb840190d21d194430 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/e1f5078546ff4bdb840190d21d194430 2023-02-13 16:03:59,872 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/.tmp/f1/bc1af94d13e745719e68c0caf57e3fd0 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/bc1af94d13e745719e68c0caf57e3fd0 2023-02-13 16:03:59,875 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/e1f5078546ff4bdb840190d21d194430, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:59,876 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/.tmp/f2/099d7c2f082c49a59ab274fd7c32b65d as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/099d7c2f082c49a59ab274fd7c32b65d 2023-02-13 16:03:59,876 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/bc1af94d13e745719e68c0caf57e3fd0, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:59,876 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/.tmp/f2/5d87d36613df4473872bf25579e0484a as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/5d87d36613df4473872bf25579e0484a 2023-02-13 16:03:59,880 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/099d7c2f082c49a59ab274fd7c32b65d, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:03:59,881 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for d49c481402c6df23fd723c27097ad156 in 43ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:59,881 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d49c481402c6df23fd723c27097ad156: 2023-02-13 16:03:59,881 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:03:59,881 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/5 local region flush tasks. 2023-02-13 16:03:59,881 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/5d87d36613df4473872bf25579e0484a, entries=2704, sequenceid=9, filesize=135.6 K 2023-02-13 16:03:59,882 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~248.22 KB/254176, heapSize ~634.22 KB/649440, currentSize=0 B/0 for e48a3cd06e30e6169b9bc9b965f5a719 in 54ms, sequenceid=9, compaction requested=false 2023-02-13 16:03:59,882 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e48a3cd06e30e6169b9bc9b965f5a719: 2023-02-13 16:03:59,882 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:03:59,882 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 4/5 local region flush tasks. 2023-02-13 16:04:00,149 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/.tmp/f1/c85fbbf3f9f448ac980d7cf02301dab3 2023-02-13 16:04:00,162 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=93.08 KB at sequenceid=9 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/.tmp/f2/c9d0da46d6dc4f9cb89b4e806027bfe5 2023-02-13 16:04:00,167 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/.tmp/f1/c85fbbf3f9f448ac980d7cf02301dab3 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/c85fbbf3f9f448ac980d7cf02301dab3 2023-02-13 16:04:00,170 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/c85fbbf3f9f448ac980d7cf02301dab3, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:04:00,171 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/.tmp/f2/c9d0da46d6dc4f9cb89b4e806027bfe5 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/c9d0da46d6dc4f9cb89b4e806027bfe5 2023-02-13 16:04:00,174 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/c9d0da46d6dc4f9cb89b4e806027bfe5, entries=2028, sequenceid=9, filesize=103.9 K 2023-02-13 16:04:00,175 INFO [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~186.16 KB/190632, heapSize ~475.78 KB/487200, currentSize=0 B/0 for 5823fbf2e700d0694fccfba5d8c7a6a1 in 467ms, sequenceid=9, compaction requested=false 2023-02-13 16:04:00,175 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 5823fbf2e700d0694fccfba5d8c7a6a1: 2023-02-13 16:04:00,175 DEBUG [rs(jenkins-hbase4.apache.org,44631,1676304236460)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:00,175 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 5/5 local region flush tasks. 2023-02-13 16:04:00,175 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 5 local region flush tasks. 2023-02-13 16:04:00,175 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,175 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceMultiRegion' locally acquired 2023-02-13 16:04:00,175 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44631,1676304236460' joining acquired barrier for procedure (testWithMockedMapReduceMultiRegion) in zk 2023-02-13 16:04:00,178 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,178 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:00,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:00,178 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,178 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceMultiRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:00,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:00,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:00,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:00,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44631,1676304236460' joining acquired barrier for procedure 'testWithMockedMapReduceMultiRegion' on coordinator 2023-02-13 16:04:00,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1611b300[Count = 0] remaining members to acquire global barrier 2023-02-13 16:04:00,179 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceMultiRegion' starting 'in-barrier' execution. 2023-02-13 16:04:00,179 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,181 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,181 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,181 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 16:04:00,181 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceMultiRegion' received 'reached' from coordinator. 2023-02-13 16:04:00,181 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 16:04:00,181 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,181 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,45019,1676304236491' in zk 2023-02-13 16:04:00,181 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceMultiRegion' locally completed 2023-02-13 16:04:00,181 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceMultiRegion' completed for member 'jenkins-hbase4.apache.org,44631,1676304236460' in zk 2023-02-13 16:04:00,181 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,181 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:04:00,182 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,183 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 16:04:00,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:00,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:00,183 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,183 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceMultiRegion' has notified controller of completion 2023-02-13 16:04:00,183 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:00,183 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:00,183 DEBUG [member: 'jenkins-hbase4.apache.org,44631,1676304236460' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 16:04:00,183 DEBUG [member: 'jenkins-hbase4.apache.org,45019,1676304236491' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceMultiRegion' completed. 2023-02-13 16:04:00,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:00,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:00,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:00,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,44631,1676304236460': 2023-02-13 16:04:00,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44631,1676304236460' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 1 more 2023-02-13 16:04:00,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:00,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:00,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:00,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:00,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:00,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceMultiRegion' member 'jenkins-hbase4.apache.org,45019,1676304236491': 2023-02-13 16:04:00,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45019,1676304236491' released barrier for procedure'testWithMockedMapReduceMultiRegion', counting down latch. Waiting for 0 more 2023-02-13 16:04:00,187 INFO [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceMultiRegion' execution completed 2023-02-13 16:04:00,187 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:04:00,187 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:04:00,188 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,188 INFO [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceMultiRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 16:04:00,189 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,189 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:00,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:00,189 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:00,189 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,189 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:00,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:00,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:00,190 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,190 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:00,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,191 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:00,192 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,200 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,200 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:00,200 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:00,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:00,200 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:00,200 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceMultiRegion' 2023-02-13 16:04:00,200 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,200 DEBUG [(jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:00,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:00,200 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:00,200 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 16:04:00,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:00,201 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:00,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:00,201 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,201 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:00,201 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,201 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceMultiRegion'' to complete. (max 20000 ms per retry) 2023-02-13 16:04:00,201 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 16:04:00,201 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,301 DEBUG [Listener at localhost/35815] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 16:04:00,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 16:04:00,307 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676304238431 type: FLUSH version: 2 ttl: 0 2023-02-13 16:04:00,307 DEBUG [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(239): region to add: 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(239): region to add: e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(239): region to add: 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(239): region to add: 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(239): region to add: 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(239): region to add: 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(239): region to add: de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(239): region to add: e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(239): region to add: d49c481402c6df23fd723c27097ad156 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(239): region to add: addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(585): clone region=8646a3d3d530cc58099faa6abb729dd2 as 8646a3d3d530cc58099faa6abb729dd2 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(585): clone region=e4c0a4179cf2b281d1840291f3c74db3 as e4c0a4179cf2b281d1840291f3c74db3 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(585): clone region=4829240dd0e63b15968d87bd3e5fc003 as 4829240dd0e63b15968d87bd3e5fc003 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(585): clone region=5823fbf2e700d0694fccfba5d8c7a6a1 as 5823fbf2e700d0694fccfba5d8c7a6a1 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,308 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(585): clone region=5ad9f94449126a32bbc91ae22c608359 as 5ad9f94449126a32bbc91ae22c608359 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,309 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(585): clone region=3e43fa2c94bcbf2834d8f3df44221897 as 3e43fa2c94bcbf2834d8f3df44221897 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,309 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(585): clone region=de2fe8e662905cab2bf9f0dcf34e33f8 as de2fe8e662905cab2bf9f0dcf34e33f8 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,309 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(585): clone region=e48a3cd06e30e6169b9bc9b965f5a719 as e48a3cd06e30e6169b9bc9b965f5a719 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,309 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(585): clone region=d49c481402c6df23fd723c27097ad156 as d49c481402c6df23fd723c27097ad156 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,309 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(585): clone region=addfc8eb7c96bb556468ea56ec55a173 as addfc8eb7c96bb556468ea56ec55a173 in snapshot testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,310 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(7671): creating {ENCODED => e48a3cd06e30e6169b9bc9b965f5a719, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,310 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8646a3d3d530cc58099faa6abb729dd2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,310 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(7671): creating {ENCODED => de2fe8e662905cab2bf9f0dcf34e33f8, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.', STARTKEY => 'zz{', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,310 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => 5ad9f94449126a32bbc91ae22c608359, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,311 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(7671): creating {ENCODED => 4829240dd0e63b15968d87bd3e5fc003, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,311 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(7671): creating {ENCODED => e4c0a4179cf2b281d1840291f3c74db3, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.', STARTKEY => 't43', ENDKEY => 'wWV'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,311 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(7671): creating {ENCODED => 5823fbf2e700d0694fccfba5d8c7a6a1, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,312 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(7671): creating {ENCODED => 3e43fa2c94bcbf2834d8f3df44221897, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,342 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:00,342 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 92bd3c66608b4081b1773d604e6f4c84 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,352 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:00,352 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 87bb14b94a4b43e88a1074e5cac33f2b from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,352 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 41d66ca00e0f4b32859d84054a34b629 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,353 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:00,353 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e47e809b3bc54d1f852df0979fc57464 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,353 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:00,353 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8762baf641ec44a8a20c5016de367b22 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,368 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:00,369 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4b2cbc3fa8bb4f32bf9fd6278dae1b03 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,369 INFO [RestoreSnapshot-pool-4] snapshot.RestoreSnapshotHelper(628): Adding HFileLink c0ac1c35e7dd409795a56ad35a360b76 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,376 INFO [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 8e11957abdbe4ac4be4b022f5245a16e from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,376 INFO [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 482510d1461843a9a9b5dc87172c9c97 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,376 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 8646a3d3d530cc58099faa6abb729dd2, disabling compactions & flushes 2023-02-13 16:04:00,376 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing 5ad9f94449126a32bbc91ae22c608359, disabling compactions & flushes 2023-02-13 16:04:00,376 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:00,376 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:00,376 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:00,377 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:00,377 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. after waiting 0 ms 2023-02-13 16:04:00,377 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:00,377 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:00,377 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 8646a3d3d530cc58099faa6abb729dd2: Waiting for close lock at 1676304240376Disabling compacts and flushes for region at 1676304240376Disabling writes for close at 1676304240377 (+1 ms)Writing region close event to WAL at 1676304240377Closed at 1676304240377 2023-02-13 16:04:00,377 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d49c481402c6df23fd723c27097ad156, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,377 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. after waiting 0 ms 2023-02-13 16:04:00,378 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:00,378 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:00,378 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for 5ad9f94449126a32bbc91ae22c608359: Waiting for close lock at 1676304240376Disabling compacts and flushes for region at 1676304240376Disabling writes for close at 1676304240378 (+2 ms)Writing region close event to WAL at 1676304240378Closed at 1676304240378 2023-02-13 16:04:00,378 INFO [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 4e30134099ed49af9daa9f06b6a8b98f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,378 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(7671): creating {ENCODED => addfc8eb7c96bb556468ea56ec55a173, NAME => 'testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.', STARTKEY => '', ENDKEY => 'aaa'}, tableDescriptor='testWithMockedMapReduceMultiRegion', {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,380 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:00,380 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 64e8681caa6c454493aa938dea17d981 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,381 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1603): Closing 5823fbf2e700d0694fccfba5d8c7a6a1, disabling compactions & flushes 2023-02-13 16:04:00,381 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:00,381 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:00,381 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. after waiting 0 ms 2023-02-13 16:04:00,381 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1603): Closing e4c0a4179cf2b281d1840291f3c74db3, disabling compactions & flushes 2023-02-13 16:04:00,381 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:00,381 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:00,381 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. after waiting 0 ms 2023-02-13 16:04:00,381 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:00,381 INFO [RestoreSnapshot-pool-1] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:00,381 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:00,382 DEBUG [RestoreSnapshot-pool-1] regionserver.HRegion(1557): Region close journal for e4c0a4179cf2b281d1840291f3c74db3: Waiting for close lock at 1676304240381Disabling compacts and flushes for region at 1676304240381Disabling writes for close at 1676304240381Writing region close event to WAL at 1676304240381Closed at 1676304240381 2023-02-13 16:04:00,382 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:00,382 INFO [RestoreSnapshot-pool-3] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:00,382 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink b0ee3425c7b64808bb1f5395ee211173 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,382 DEBUG [RestoreSnapshot-pool-3] regionserver.HRegion(1557): Region close journal for 5823fbf2e700d0694fccfba5d8c7a6a1: Waiting for close lock at 1676304240381Disabling compacts and flushes for region at 1676304240381Disabling writes for close at 1676304240381Writing region close event to WAL at 1676304240382 (+1 ms)Closed at 1676304240382 2023-02-13 16:04:00,384 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:00,384 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1603): Closing de2fe8e662905cab2bf9f0dcf34e33f8, disabling compactions & flushes 2023-02-13 16:04:00,384 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:00,384 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:00,384 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. after waiting 0 ms 2023-02-13 16:04:00,384 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:00,384 INFO [RestoreSnapshot-pool-6] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:00,384 DEBUG [RestoreSnapshot-pool-6] regionserver.HRegion(1557): Region close journal for de2fe8e662905cab2bf9f0dcf34e33f8: Waiting for close lock at 1676304240384Disabling compacts and flushes for region at 1676304240384Disabling writes for close at 1676304240384Writing region close event to WAL at 1676304240384Closed at 1676304240384 2023-02-13 16:04:00,388 INFO [RestoreSnapshot-pool-7] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 1be7e12791994bfeac71865d982e7394 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,388 INFO [RestoreSnapshot-pool-5] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 279a84e4cdcf4ffb9651a5cb33ad0654 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,392 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1603): Closing 4829240dd0e63b15968d87bd3e5fc003, disabling compactions & flushes 2023-02-13 16:04:00,392 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:00,392 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:00,392 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. after waiting 0 ms 2023-02-13 16:04:00,392 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:00,392 INFO [RestoreSnapshot-pool-2] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:00,392 DEBUG [RestoreSnapshot-pool-2] regionserver.HRegion(1557): Region close journal for 4829240dd0e63b15968d87bd3e5fc003: Waiting for close lock at 1676304240392Disabling compacts and flushes for region at 1676304240392Disabling writes for close at 1676304240392Writing region close event to WAL at 1676304240392Closed at 1676304240392 2023-02-13 16:04:00,396 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1603): Closing e48a3cd06e30e6169b9bc9b965f5a719, disabling compactions & flushes 2023-02-13 16:04:00,396 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:00,396 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:00,396 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. after waiting 0 ms 2023-02-13 16:04:00,396 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:00,396 INFO [RestoreSnapshot-pool-7] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:00,396 DEBUG [RestoreSnapshot-pool-7] regionserver.HRegion(1557): Region close journal for e48a3cd06e30e6169b9bc9b965f5a719: Waiting for close lock at 1676304240396Disabling compacts and flushes for region at 1676304240396Disabling writes for close at 1676304240396Writing region close event to WAL at 1676304240396Closed at 1676304240396 2023-02-13 16:04:00,399 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1603): Closing 3e43fa2c94bcbf2834d8f3df44221897, disabling compactions & flushes 2023-02-13 16:04:00,399 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:00,399 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:00,400 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:00,400 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. after waiting 0 ms 2023-02-13 16:04:00,400 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1603): Closing addfc8eb7c96bb556468ea56ec55a173, disabling compactions & flushes 2023-02-13 16:04:00,400 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:00,400 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:00,400 INFO [RestoreSnapshot-pool-5] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:00,400 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:00,400 DEBUG [RestoreSnapshot-pool-5] regionserver.HRegion(1557): Region close journal for 3e43fa2c94bcbf2834d8f3df44221897: Waiting for close lock at 1676304240399Disabling compacts and flushes for region at 1676304240399Disabling writes for close at 1676304240400 (+1 ms)Writing region close event to WAL at 1676304240400Closed at 1676304240400 2023-02-13 16:04:00,400 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. after waiting 0 ms 2023-02-13 16:04:00,400 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:00,400 INFO [RestoreSnapshot-pool-4] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:00,400 DEBUG [RestoreSnapshot-pool-4] regionserver.HRegion(1557): Region close journal for addfc8eb7c96bb556468ea56ec55a173: Waiting for close lock at 1676304240400Disabling compacts and flushes for region at 1676304240400Disabling writes for close at 1676304240400Writing region close event to WAL at 1676304240400Closed at 1676304240400 2023-02-13 16:04:00,401 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:00,401 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 0405118835f340b8b62444cdaee73f0f from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,403 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9ccb05b3b442436cb9ed9aa3f6839c82 from cloned region in snapshot testWithMockedMapReduceMultiRegion to table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:00,405 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d49c481402c6df23fd723c27097ad156, disabling compactions & flushes 2023-02-13 16:04:00,405 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:00,405 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:00,405 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. after waiting 0 ms 2023-02-13 16:04:00,405 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:00,405 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:00,405 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d49c481402c6df23fd723c27097ad156: Waiting for close lock at 1676304240405Disabling compacts and flushes for region at 1676304240405Disabling writes for close at 1676304240405Writing region close event to WAL at 1676304240405Closed at 1676304240405 2023-02-13 16:04:00,405 INFO [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceMultiRegion" table: "testWithMockedMapReduceMultiRegion" creation_time: 1676304238431 type: FLUSH version: 2 ttl: 0 2023-02-13 16:04:00,405 DEBUG [Listener at localhost/35815] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,405 DEBUG [Listener at localhost/35815] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169 2023-02-13 16:04:00,406 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-data/ 2023-02-13 16:04:00,406 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----default/ 2023-02-13 16:04:00,407 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------testWithMockedMapReduceMultiRegion/ 2023-02-13 16:04:00,407 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----------3e43fa2c94bcbf2834d8f3df44221897/ 2023-02-13 16:04:00,407 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:00,407 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:00,408 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3e43fa2c94bcbf2834d8f3df44221897-64e8681caa6c454493aa938dea17d981 2023-02-13 16:04:00,408 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:00,408 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=3e43fa2c94bcbf2834d8f3df44221897-279a84e4cdcf4ffb9651a5cb33ad0654 2023-02-13 16:04:00,408 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----------4829240dd0e63b15968d87bd3e5fc003/ 2023-02-13 16:04:00,409 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:00,409 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:00,409 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4829240dd0e63b15968d87bd3e5fc003-4b2cbc3fa8bb4f32bf9fd6278dae1b03 2023-02-13 16:04:00,409 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:00,409 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=4829240dd0e63b15968d87bd3e5fc003-4e30134099ed49af9daa9f06b6a8b98f 2023-02-13 16:04:00,409 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----------5823fbf2e700d0694fccfba5d8c7a6a1/ 2023-02-13 16:04:00,409 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:00,410 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:00,410 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5823fbf2e700d0694fccfba5d8c7a6a1-8762baf641ec44a8a20c5016de367b22 2023-02-13 16:04:00,410 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:00,410 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5823fbf2e700d0694fccfba5d8c7a6a1-8e11957abdbe4ac4be4b022f5245a16e 2023-02-13 16:04:00,410 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----------5ad9f94449126a32bbc91ae22c608359/ 2023-02-13 16:04:00,410 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:00,411 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:00,411 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5ad9f94449126a32bbc91ae22c608359-87bb14b94a4b43e88a1074e5cac33f2b 2023-02-13 16:04:00,411 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:00,411 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=5ad9f94449126a32bbc91ae22c608359-c0ac1c35e7dd409795a56ad35a360b76 2023-02-13 16:04:00,411 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----------8646a3d3d530cc58099faa6abb729dd2/ 2023-02-13 16:04:00,411 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:00,411 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:00,412 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8646a3d3d530cc58099faa6abb729dd2-92bd3c66608b4081b1773d604e6f4c84 2023-02-13 16:04:00,412 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:00,412 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=8646a3d3d530cc58099faa6abb729dd2-41d66ca00e0f4b32859d84054a34b629 2023-02-13 16:04:00,412 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----------addfc8eb7c96bb556468ea56ec55a173/ 2023-02-13 16:04:00,412 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:00,412 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----------d49c481402c6df23fd723c27097ad156/ 2023-02-13 16:04:00,413 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:00,413 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:00,413 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d49c481402c6df23fd723c27097ad156-0405118835f340b8b62444cdaee73f0f 2023-02-13 16:04:00,413 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:00,413 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=d49c481402c6df23fd723c27097ad156-9ccb05b3b442436cb9ed9aa3f6839c82 2023-02-13 16:04:00,413 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----------de2fe8e662905cab2bf9f0dcf34e33f8/ 2023-02-13 16:04:00,414 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:00,414 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----------e48a3cd06e30e6169b9bc9b965f5a719/ 2023-02-13 16:04:00,414 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:00,414 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:00,414 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e48a3cd06e30e6169b9bc9b965f5a719-b0ee3425c7b64808bb1f5395ee211173 2023-02-13 16:04:00,414 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:00,414 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e48a3cd06e30e6169b9bc9b965f5a719-1be7e12791994bfeac71865d982e7394 2023-02-13 16:04:00,415 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |----------e4c0a4179cf2b281d1840291f3c74db3/ 2023-02-13 16:04:00,415 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:00,415 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:00,415 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e4c0a4179cf2b281d1840291f3c74db3-e47e809b3bc54d1f852df0979fc57464 2023-02-13 16:04:00,415 DEBUG [Listener at localhost/35815] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:00,415 DEBUG [Listener at localhost/35815] util.CommonFSUtils(702): |----------------testWithMockedMapReduceMultiRegion=e4c0a4179cf2b281d1840291f3c74db3-482510d1461843a9a9b5dc87172c9c97 2023-02-13 16:04:00,418 INFO [Listener at localhost/35815] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 16:04:01,075 DEBUG [Listener at localhost/35815] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:01,075 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:01,077 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:01,079 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:04:01,080 DEBUG [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1 2023-02-13 16:04:01,080 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ad9f94449126a32bbc91ae22c608359 columnFamilyName f1 2023-02-13 16:04:01,084 DEBUG [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/testWithMockedMapReduceMultiRegion=5ad9f94449126a32bbc91ae22c608359-87bb14b94a4b43e88a1074e5cac33f2b 2023-02-13 16:04:01,084 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] regionserver.HStore(310): Store=5ad9f94449126a32bbc91ae22c608359/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,084 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:04:01,085 DEBUG [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2 2023-02-13 16:04:01,085 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5ad9f94449126a32bbc91ae22c608359 columnFamilyName f2 2023-02-13 16:04:01,089 DEBUG [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/testWithMockedMapReduceMultiRegion=5ad9f94449126a32bbc91ae22c608359-c0ac1c35e7dd409795a56ad35a360b76 2023-02-13 16:04:01,089 INFO [StoreOpener-5ad9f94449126a32bbc91ae22c608359-1] regionserver.HStore(310): Store=5ad9f94449126a32bbc91ae22c608359/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,089 DEBUG [Listener at localhost/35815] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:01,089 INFO [Listener at localhost/35815] regionserver.HRegion(1071): Opened 5ad9f94449126a32bbc91ae22c608359; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70765150, jitterRate=0.05448290705680847}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:01,089 DEBUG [Listener at localhost/35815] regionserver.HRegion(964): Region open journal for 5ad9f94449126a32bbc91ae22c608359: Writing region info on filesystem at 1676304241077Initializing all the Stores at 1676304241078 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241078Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241078Region opened successfully at 1676304241089 (+11 ms) 2023-02-13 16:04:01,100 DEBUG [Listener at localhost/35815] regionserver.HRegion(1603): Closing 5ad9f94449126a32bbc91ae22c608359, disabling compactions & flushes 2023-02-13 16:04:01,102 INFO [Listener at localhost/35815] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:01,102 DEBUG [Listener at localhost/35815] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:01,102 DEBUG [Listener at localhost/35815] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. after waiting 0 ms 2023-02-13 16:04:01,102 DEBUG [Listener at localhost/35815] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:01,108 INFO [Listener at localhost/35815] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:01,108 DEBUG [Listener at localhost/35815] regionserver.HRegion(1557): Region close journal for 5ad9f94449126a32bbc91ae22c608359: Waiting for close lock at 1676304241100Disabling compacts and flushes for region at 1676304241100Disabling writes for close at 1676304241102 (+2 ms)Writing region close event to WAL at 1676304241108 (+6 ms)Closed at 1676304241108 2023-02-13 16:04:01,109 DEBUG [Listener at localhost/35815] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:01,109 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:01,110 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:01,112 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:04:01,113 DEBUG [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1 2023-02-13 16:04:01,113 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e43fa2c94bcbf2834d8f3df44221897 columnFamilyName f1 2023-02-13 16:04:01,117 DEBUG [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/testWithMockedMapReduceMultiRegion=3e43fa2c94bcbf2834d8f3df44221897-64e8681caa6c454493aa938dea17d981 2023-02-13 16:04:01,117 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] regionserver.HStore(310): Store=3e43fa2c94bcbf2834d8f3df44221897/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,117 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:04:01,118 DEBUG [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2 2023-02-13 16:04:01,118 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e43fa2c94bcbf2834d8f3df44221897 columnFamilyName f2 2023-02-13 16:04:01,121 DEBUG [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/testWithMockedMapReduceMultiRegion=3e43fa2c94bcbf2834d8f3df44221897-279a84e4cdcf4ffb9651a5cb33ad0654 2023-02-13 16:04:01,121 INFO [StoreOpener-3e43fa2c94bcbf2834d8f3df44221897-1] regionserver.HStore(310): Store=3e43fa2c94bcbf2834d8f3df44221897/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,121 DEBUG [Listener at localhost/35815] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:01,122 INFO [Listener at localhost/35815] regionserver.HRegion(1071): Opened 3e43fa2c94bcbf2834d8f3df44221897; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68903599, jitterRate=0.026743635535240173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:01,122 DEBUG [Listener at localhost/35815] regionserver.HRegion(964): Region open journal for 3e43fa2c94bcbf2834d8f3df44221897: Writing region info on filesystem at 1676304241110Initializing all the Stores at 1676304241111 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241111Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241111Region opened successfully at 1676304241122 (+11 ms) 2023-02-13 16:04:01,129 DEBUG [Listener at localhost/35815] regionserver.HRegion(1603): Closing 3e43fa2c94bcbf2834d8f3df44221897, disabling compactions & flushes 2023-02-13 16:04:01,129 INFO [Listener at localhost/35815] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:01,129 DEBUG [Listener at localhost/35815] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:01,130 DEBUG [Listener at localhost/35815] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. after waiting 0 ms 2023-02-13 16:04:01,130 DEBUG [Listener at localhost/35815] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:01,130 INFO [Listener at localhost/35815] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:01,130 DEBUG [Listener at localhost/35815] regionserver.HRegion(1557): Region close journal for 3e43fa2c94bcbf2834d8f3df44221897: Waiting for close lock at 1676304241129Disabling compacts and flushes for region at 1676304241129Disabling writes for close at 1676304241130 (+1 ms)Writing region close event to WAL at 1676304241130Closed at 1676304241130 2023-02-13 16:04:01,131 DEBUG [Listener at localhost/35815] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:01,131 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:01,132 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:01,134 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:04:01,135 DEBUG [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/f1 2023-02-13 16:04:01,135 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de2fe8e662905cab2bf9f0dcf34e33f8 columnFamilyName f1 2023-02-13 16:04:01,135 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] regionserver.HStore(310): Store=de2fe8e662905cab2bf9f0dcf34e33f8/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,135 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:04:01,136 DEBUG [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/f2 2023-02-13 16:04:01,137 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de2fe8e662905cab2bf9f0dcf34e33f8 columnFamilyName f2 2023-02-13 16:04:01,137 INFO [StoreOpener-de2fe8e662905cab2bf9f0dcf34e33f8-1] regionserver.HStore(310): Store=de2fe8e662905cab2bf9f0dcf34e33f8/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,137 DEBUG [Listener at localhost/35815] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:01,137 INFO [Listener at localhost/35815] regionserver.HRegion(1071): Opened de2fe8e662905cab2bf9f0dcf34e33f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62238705, jitterRate=-0.07257102429866791}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:01,137 DEBUG [Listener at localhost/35815] regionserver.HRegion(964): Region open journal for de2fe8e662905cab2bf9f0dcf34e33f8: Writing region info on filesystem at 1676304241132Initializing all the Stores at 1676304241133 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241133Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241133Region opened successfully at 1676304241137 (+4 ms) 2023-02-13 16:04:01,137 DEBUG [Listener at localhost/35815] regionserver.HRegion(1603): Closing de2fe8e662905cab2bf9f0dcf34e33f8, disabling compactions & flushes 2023-02-13 16:04:01,137 INFO [Listener at localhost/35815] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:01,137 DEBUG [Listener at localhost/35815] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:01,137 DEBUG [Listener at localhost/35815] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. after waiting 0 ms 2023-02-13 16:04:01,138 DEBUG [Listener at localhost/35815] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:01,138 INFO [Listener at localhost/35815] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:01,138 DEBUG [Listener at localhost/35815] regionserver.HRegion(1557): Region close journal for de2fe8e662905cab2bf9f0dcf34e33f8: Waiting for close lock at 1676304241137Disabling compacts and flushes for region at 1676304241137Disabling writes for close at 1676304241138 (+1 ms)Writing region close event to WAL at 1676304241138Closed at 1676304241138 2023-02-13 16:04:01,138 DEBUG [Listener at localhost/35815] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:01,138 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:01,140 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:01,141 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:04:01,142 DEBUG [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1 2023-02-13 16:04:01,142 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5823fbf2e700d0694fccfba5d8c7a6a1 columnFamilyName f1 2023-02-13 16:04:01,148 DEBUG [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/testWithMockedMapReduceMultiRegion=5823fbf2e700d0694fccfba5d8c7a6a1-8762baf641ec44a8a20c5016de367b22 2023-02-13 16:04:01,148 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] regionserver.HStore(310): Store=5823fbf2e700d0694fccfba5d8c7a6a1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,148 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:04:01,149 DEBUG [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2 2023-02-13 16:04:01,149 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5823fbf2e700d0694fccfba5d8c7a6a1 columnFamilyName f2 2023-02-13 16:04:01,153 DEBUG [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/testWithMockedMapReduceMultiRegion=5823fbf2e700d0694fccfba5d8c7a6a1-8e11957abdbe4ac4be4b022f5245a16e 2023-02-13 16:04:01,153 INFO [StoreOpener-5823fbf2e700d0694fccfba5d8c7a6a1-1] regionserver.HStore(310): Store=5823fbf2e700d0694fccfba5d8c7a6a1/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,153 DEBUG [Listener at localhost/35815] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:01,153 INFO [Listener at localhost/35815] regionserver.HRegion(1071): Opened 5823fbf2e700d0694fccfba5d8c7a6a1; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73676180, jitterRate=0.09786063432693481}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:01,153 DEBUG [Listener at localhost/35815] regionserver.HRegion(964): Region open journal for 5823fbf2e700d0694fccfba5d8c7a6a1: Writing region info on filesystem at 1676304241140Initializing all the Stores at 1676304241140Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241140Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241141 (+1 ms)Region opened successfully at 1676304241153 (+12 ms) 2023-02-13 16:04:01,162 DEBUG [Listener at localhost/35815] regionserver.HRegion(1603): Closing 5823fbf2e700d0694fccfba5d8c7a6a1, disabling compactions & flushes 2023-02-13 16:04:01,163 INFO [Listener at localhost/35815] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:01,163 DEBUG [Listener at localhost/35815] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:01,163 DEBUG [Listener at localhost/35815] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. after waiting 0 ms 2023-02-13 16:04:01,163 DEBUG [Listener at localhost/35815] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:01,166 INFO [Listener at localhost/35815] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:01,166 DEBUG [Listener at localhost/35815] regionserver.HRegion(1557): Region close journal for 5823fbf2e700d0694fccfba5d8c7a6a1: Waiting for close lock at 1676304241162Disabling compacts and flushes for region at 1676304241162Disabling writes for close at 1676304241163 (+1 ms)Writing region close event to WAL at 1676304241166 (+3 ms)Closed at 1676304241166 2023-02-13 16:04:01,166 DEBUG [Listener at localhost/35815] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:01,167 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:01,170 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:01,172 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d49c481402c6df23fd723c27097ad156 2023-02-13 16:04:01,173 DEBUG [StoreOpener-d49c481402c6df23fd723c27097ad156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1 2023-02-13 16:04:01,174 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d49c481402c6df23fd723c27097ad156 columnFamilyName f1 2023-02-13 16:04:01,178 DEBUG [StoreOpener-d49c481402c6df23fd723c27097ad156-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/testWithMockedMapReduceMultiRegion=d49c481402c6df23fd723c27097ad156-0405118835f340b8b62444cdaee73f0f 2023-02-13 16:04:01,178 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] regionserver.HStore(310): Store=d49c481402c6df23fd723c27097ad156/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,178 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d49c481402c6df23fd723c27097ad156 2023-02-13 16:04:01,179 DEBUG [StoreOpener-d49c481402c6df23fd723c27097ad156-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2 2023-02-13 16:04:01,179 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d49c481402c6df23fd723c27097ad156 columnFamilyName f2 2023-02-13 16:04:01,183 DEBUG [StoreOpener-d49c481402c6df23fd723c27097ad156-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/testWithMockedMapReduceMultiRegion=d49c481402c6df23fd723c27097ad156-9ccb05b3b442436cb9ed9aa3f6839c82 2023-02-13 16:04:01,183 INFO [StoreOpener-d49c481402c6df23fd723c27097ad156-1] regionserver.HStore(310): Store=d49c481402c6df23fd723c27097ad156/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,183 DEBUG [Listener at localhost/35815] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:01,183 INFO [Listener at localhost/35815] regionserver.HRegion(1071): Opened d49c481402c6df23fd723c27097ad156; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67353844, jitterRate=0.003650486469268799}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:01,183 DEBUG [Listener at localhost/35815] regionserver.HRegion(964): Region open journal for d49c481402c6df23fd723c27097ad156: Writing region info on filesystem at 1676304241170Initializing all the Stores at 1676304241171 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241171Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241171Region opened successfully at 1676304241183 (+12 ms) 2023-02-13 16:04:01,199 DEBUG [Listener at localhost/35815] regionserver.HRegion(1603): Closing d49c481402c6df23fd723c27097ad156, disabling compactions & flushes 2023-02-13 16:04:01,200 INFO [Listener at localhost/35815] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:01,200 DEBUG [Listener at localhost/35815] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:01,200 DEBUG [Listener at localhost/35815] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. after waiting 0 ms 2023-02-13 16:04:01,200 DEBUG [Listener at localhost/35815] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:01,201 INFO [Listener at localhost/35815] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:01,201 DEBUG [Listener at localhost/35815] regionserver.HRegion(1557): Region close journal for d49c481402c6df23fd723c27097ad156: Waiting for close lock at 1676304241199Disabling compacts and flushes for region at 1676304241199Disabling writes for close at 1676304241200 (+1 ms)Writing region close event to WAL at 1676304241201 (+1 ms)Closed at 1676304241201 2023-02-13 16:04:01,201 DEBUG [Listener at localhost/35815] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:01,202 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:01,203 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:01,205 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:04:01,206 DEBUG [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1 2023-02-13 16:04:01,206 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e48a3cd06e30e6169b9bc9b965f5a719 columnFamilyName f1 2023-02-13 16:04:01,210 DEBUG [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/testWithMockedMapReduceMultiRegion=e48a3cd06e30e6169b9bc9b965f5a719-b0ee3425c7b64808bb1f5395ee211173 2023-02-13 16:04:01,210 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] regionserver.HStore(310): Store=e48a3cd06e30e6169b9bc9b965f5a719/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,210 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:04:01,211 DEBUG [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2 2023-02-13 16:04:01,211 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e48a3cd06e30e6169b9bc9b965f5a719 columnFamilyName f2 2023-02-13 16:04:01,215 DEBUG [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/testWithMockedMapReduceMultiRegion=e48a3cd06e30e6169b9bc9b965f5a719-1be7e12791994bfeac71865d982e7394 2023-02-13 16:04:01,215 INFO [StoreOpener-e48a3cd06e30e6169b9bc9b965f5a719-1] regionserver.HStore(310): Store=e48a3cd06e30e6169b9bc9b965f5a719/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,215 DEBUG [Listener at localhost/35815] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:01,215 INFO [Listener at localhost/35815] regionserver.HRegion(1071): Opened e48a3cd06e30e6169b9bc9b965f5a719; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73473473, jitterRate=0.09484006464481354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:01,215 DEBUG [Listener at localhost/35815] regionserver.HRegion(964): Region open journal for e48a3cd06e30e6169b9bc9b965f5a719: Writing region info on filesystem at 1676304241203Initializing all the Stores at 1676304241204 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241204Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241204Region opened successfully at 1676304241215 (+11 ms) 2023-02-13 16:04:01,225 DEBUG [Listener at localhost/35815] regionserver.HRegion(1603): Closing e48a3cd06e30e6169b9bc9b965f5a719, disabling compactions & flushes 2023-02-13 16:04:01,225 INFO [Listener at localhost/35815] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:01,225 DEBUG [Listener at localhost/35815] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:01,225 DEBUG [Listener at localhost/35815] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. after waiting 0 ms 2023-02-13 16:04:01,225 DEBUG [Listener at localhost/35815] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:01,225 INFO [Listener at localhost/35815] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:01,226 DEBUG [Listener at localhost/35815] regionserver.HRegion(1557): Region close journal for e48a3cd06e30e6169b9bc9b965f5a719: Waiting for close lock at 1676304241225Disabling compacts and flushes for region at 1676304241225Disabling writes for close at 1676304241225Writing region close event to WAL at 1676304241225Closed at 1676304241225 2023-02-13 16:04:01,226 DEBUG [Listener at localhost/35815] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:01,226 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:01,227 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:01,229 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:04:01,230 DEBUG [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1 2023-02-13 16:04:01,230 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8646a3d3d530cc58099faa6abb729dd2 columnFamilyName f1 2023-02-13 16:04:01,234 DEBUG [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/testWithMockedMapReduceMultiRegion=8646a3d3d530cc58099faa6abb729dd2-92bd3c66608b4081b1773d604e6f4c84 2023-02-13 16:04:01,234 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] regionserver.HStore(310): Store=8646a3d3d530cc58099faa6abb729dd2/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,234 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:04:01,235 DEBUG [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2 2023-02-13 16:04:01,235 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8646a3d3d530cc58099faa6abb729dd2 columnFamilyName f2 2023-02-13 16:04:01,239 DEBUG [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/testWithMockedMapReduceMultiRegion=8646a3d3d530cc58099faa6abb729dd2-41d66ca00e0f4b32859d84054a34b629 2023-02-13 16:04:01,239 INFO [StoreOpener-8646a3d3d530cc58099faa6abb729dd2-1] regionserver.HStore(310): Store=8646a3d3d530cc58099faa6abb729dd2/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,239 DEBUG [Listener at localhost/35815] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:01,239 INFO [Listener at localhost/35815] regionserver.HRegion(1071): Opened 8646a3d3d530cc58099faa6abb729dd2; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69925461, jitterRate=0.04197056591510773}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:01,239 DEBUG [Listener at localhost/35815] regionserver.HRegion(964): Region open journal for 8646a3d3d530cc58099faa6abb729dd2: Writing region info on filesystem at 1676304241228Initializing all the Stores at 1676304241228Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241228Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241228Region opened successfully at 1676304241239 (+11 ms) 2023-02-13 16:04:01,247 DEBUG [Listener at localhost/35815] regionserver.HRegion(1603): Closing 8646a3d3d530cc58099faa6abb729dd2, disabling compactions & flushes 2023-02-13 16:04:01,247 INFO [Listener at localhost/35815] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:01,247 DEBUG [Listener at localhost/35815] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:01,247 DEBUG [Listener at localhost/35815] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. after waiting 0 ms 2023-02-13 16:04:01,247 DEBUG [Listener at localhost/35815] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:01,248 INFO [Listener at localhost/35815] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:01,248 DEBUG [Listener at localhost/35815] regionserver.HRegion(1557): Region close journal for 8646a3d3d530cc58099faa6abb729dd2: Waiting for close lock at 1676304241247Disabling compacts and flushes for region at 1676304241247Disabling writes for close at 1676304241247Writing region close event to WAL at 1676304241248 (+1 ms)Closed at 1676304241248 2023-02-13 16:04:01,248 DEBUG [Listener at localhost/35815] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:01,248 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:01,250 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:01,251 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:04:01,252 DEBUG [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/f1 2023-02-13 16:04:01,253 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region addfc8eb7c96bb556468ea56ec55a173 columnFamilyName f1 2023-02-13 16:04:01,253 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] regionserver.HStore(310): Store=addfc8eb7c96bb556468ea56ec55a173/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,253 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:04:01,254 DEBUG [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/f2 2023-02-13 16:04:01,254 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region addfc8eb7c96bb556468ea56ec55a173 columnFamilyName f2 2023-02-13 16:04:01,255 INFO [StoreOpener-addfc8eb7c96bb556468ea56ec55a173-1] regionserver.HStore(310): Store=addfc8eb7c96bb556468ea56ec55a173/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,255 DEBUG [Listener at localhost/35815] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:01,255 INFO [Listener at localhost/35815] regionserver.HRegion(1071): Opened addfc8eb7c96bb556468ea56ec55a173; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60367937, jitterRate=-0.1004476398229599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:01,255 DEBUG [Listener at localhost/35815] regionserver.HRegion(964): Region open journal for addfc8eb7c96bb556468ea56ec55a173: Writing region info on filesystem at 1676304241250Initializing all the Stores at 1676304241250Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241250Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241250Region opened successfully at 1676304241255 (+5 ms) 2023-02-13 16:04:01,255 DEBUG [Listener at localhost/35815] regionserver.HRegion(1603): Closing addfc8eb7c96bb556468ea56ec55a173, disabling compactions & flushes 2023-02-13 16:04:01,255 INFO [Listener at localhost/35815] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:01,255 DEBUG [Listener at localhost/35815] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:01,255 DEBUG [Listener at localhost/35815] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. after waiting 0 ms 2023-02-13 16:04:01,255 DEBUG [Listener at localhost/35815] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:01,256 INFO [Listener at localhost/35815] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:01,256 DEBUG [Listener at localhost/35815] regionserver.HRegion(1557): Region close journal for addfc8eb7c96bb556468ea56ec55a173: Waiting for close lock at 1676304241255Disabling compacts and flushes for region at 1676304241255Disabling writes for close at 1676304241255Writing region close event to WAL at 1676304241256 (+1 ms)Closed at 1676304241256 2023-02-13 16:04:01,256 DEBUG [Listener at localhost/35815] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:01,256 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:01,260 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:01,261 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:04:01,262 DEBUG [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1 2023-02-13 16:04:01,262 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4829240dd0e63b15968d87bd3e5fc003 columnFamilyName f1 2023-02-13 16:04:01,266 DEBUG [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/testWithMockedMapReduceMultiRegion=4829240dd0e63b15968d87bd3e5fc003-4b2cbc3fa8bb4f32bf9fd6278dae1b03 2023-02-13 16:04:01,267 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] regionserver.HStore(310): Store=4829240dd0e63b15968d87bd3e5fc003/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,267 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:04:01,267 DEBUG [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2 2023-02-13 16:04:01,268 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4829240dd0e63b15968d87bd3e5fc003 columnFamilyName f2 2023-02-13 16:04:01,271 DEBUG [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/testWithMockedMapReduceMultiRegion=4829240dd0e63b15968d87bd3e5fc003-4e30134099ed49af9daa9f06b6a8b98f 2023-02-13 16:04:01,271 INFO [StoreOpener-4829240dd0e63b15968d87bd3e5fc003-1] regionserver.HStore(310): Store=4829240dd0e63b15968d87bd3e5fc003/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,271 DEBUG [Listener at localhost/35815] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:01,272 INFO [Listener at localhost/35815] regionserver.HRegion(1071): Opened 4829240dd0e63b15968d87bd3e5fc003; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60815398, jitterRate=-0.09377995133399963}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:01,272 DEBUG [Listener at localhost/35815] regionserver.HRegion(964): Region open journal for 4829240dd0e63b15968d87bd3e5fc003: Writing region info on filesystem at 1676304241260Initializing all the Stores at 1676304241260Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241260Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241260Region opened successfully at 1676304241272 (+12 ms) 2023-02-13 16:04:01,281 DEBUG [Listener at localhost/35815] regionserver.HRegion(1603): Closing 4829240dd0e63b15968d87bd3e5fc003, disabling compactions & flushes 2023-02-13 16:04:01,281 INFO [Listener at localhost/35815] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:01,281 DEBUG [Listener at localhost/35815] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:01,281 DEBUG [Listener at localhost/35815] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. after waiting 0 ms 2023-02-13 16:04:01,281 DEBUG [Listener at localhost/35815] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:01,282 INFO [Listener at localhost/35815] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:01,282 DEBUG [Listener at localhost/35815] regionserver.HRegion(1557): Region close journal for 4829240dd0e63b15968d87bd3e5fc003: Waiting for close lock at 1676304241281Disabling compacts and flushes for region at 1676304241281Disabling writes for close at 1676304241281Writing region close event to WAL at 1676304241282 (+1 ms)Closed at 1676304241282 2023-02-13 16:04:01,282 DEBUG [Listener at localhost/35815] regionserver.HRegion(865): Instantiated testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:01,283 INFO [Listener at localhost/35815] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:01,284 DEBUG [Listener at localhost/35815] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:01,285 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:04:01,286 DEBUG [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1 2023-02-13 16:04:01,286 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4c0a4179cf2b281d1840291f3c74db3 columnFamilyName f1 2023-02-13 16:04:01,290 DEBUG [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/testWithMockedMapReduceMultiRegion=e4c0a4179cf2b281d1840291f3c74db3-e47e809b3bc54d1f852df0979fc57464 2023-02-13 16:04:01,290 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] regionserver.HStore(310): Store=e4c0a4179cf2b281d1840291f3c74db3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,290 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:04:01,291 DEBUG [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2 2023-02-13 16:04:01,291 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4c0a4179cf2b281d1840291f3c74db3 columnFamilyName f2 2023-02-13 16:04:01,295 DEBUG [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] regionserver.HStore(539): loaded hdfs://localhost:45659/user/jenkins/test-data/68d3f4b3-f165-91a8-8b26-938512b4b124/testWithMockedMapReduceMultiRegion/c86c77dc-b4cf-46bc-9a74-9f84e8941169/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/testWithMockedMapReduceMultiRegion=e4c0a4179cf2b281d1840291f3c74db3-482510d1461843a9a9b5dc87172c9c97 2023-02-13 16:04:01,295 INFO [StoreOpener-e4c0a4179cf2b281d1840291f3c74db3-1] regionserver.HStore(310): Store=e4c0a4179cf2b281d1840291f3c74db3/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:01,295 DEBUG [Listener at localhost/35815] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceMultiRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:01,295 INFO [Listener at localhost/35815] regionserver.HRegion(1071): Opened e4c0a4179cf2b281d1840291f3c74db3; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62498757, jitterRate=-0.06869594752788544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:01,295 DEBUG [Listener at localhost/35815] regionserver.HRegion(964): Region open journal for e4c0a4179cf2b281d1840291f3c74db3: Writing region info on filesystem at 1676304241284Initializing all the Stores at 1676304241284Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241284Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304241285 (+1 ms)Region opened successfully at 1676304241295 (+10 ms) 2023-02-13 16:04:01,302 DEBUG [Listener at localhost/35815] regionserver.HRegion(1603): Closing e4c0a4179cf2b281d1840291f3c74db3, disabling compactions & flushes 2023-02-13 16:04:01,302 INFO [Listener at localhost/35815] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:01,302 DEBUG [Listener at localhost/35815] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:01,303 DEBUG [Listener at localhost/35815] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. after waiting 0 ms 2023-02-13 16:04:01,303 DEBUG [Listener at localhost/35815] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:01,303 INFO [Listener at localhost/35815] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:01,303 DEBUG [Listener at localhost/35815] regionserver.HRegion(1557): Region close journal for e4c0a4179cf2b281d1840291f3c74db3: Waiting for close lock at 1676304241302Disabling compacts and flushes for region at 1676304241302Disabling writes for close at 1676304241303 (+1 ms)Writing region close event to WAL at 1676304241303Closed at 1676304241303 2023-02-13 16:04:01,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceMultiRegion" 2023-02-13 16:04:01,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,311 INFO [Listener at localhost/35815] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 16:04:01,314 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304241314"}]},"ts":"1676304241314"} 2023-02-13 16:04:01,316 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLING in hbase:meta 2023-02-13 16:04:01,317 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceMultiRegion to state=DISABLING 2023-02-13 16:04:01,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=addfc8eb7c96bb556468ea56ec55a173, UNASSIGN}, {pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e48a3cd06e30e6169b9bc9b965f5a719, UNASSIGN}, {pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d49c481402c6df23fd723c27097ad156, UNASSIGN}, {pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8646a3d3d530cc58099faa6abb729dd2, UNASSIGN}, {pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5823fbf2e700d0694fccfba5d8c7a6a1, UNASSIGN}, {pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3e43fa2c94bcbf2834d8f3df44221897, UNASSIGN}, {pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5ad9f94449126a32bbc91ae22c608359, UNASSIGN}, {pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4c0a4179cf2b281d1840291f3c74db3, UNASSIGN}, {pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4829240dd0e63b15968d87bd3e5fc003, UNASSIGN}, {pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de2fe8e662905cab2bf9f0dcf34e33f8, UNASSIGN}] 2023-02-13 16:04:01,319 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=35, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e48a3cd06e30e6169b9bc9b965f5a719, UNASSIGN 2023-02-13 16:04:01,320 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8646a3d3d530cc58099faa6abb729dd2, UNASSIGN 2023-02-13 16:04:01,320 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=34, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=addfc8eb7c96bb556468ea56ec55a173, UNASSIGN 2023-02-13 16:04:01,320 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5823fbf2e700d0694fccfba5d8c7a6a1, UNASSIGN 2023-02-13 16:04:01,320 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de2fe8e662905cab2bf9f0dcf34e33f8, UNASSIGN 2023-02-13 16:04:01,320 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e48a3cd06e30e6169b9bc9b965f5a719, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:01,320 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8646a3d3d530cc58099faa6abb729dd2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:01,320 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=addfc8eb7c96bb556468ea56ec55a173, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:01,320 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5823fbf2e700d0694fccfba5d8c7a6a1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:01,320 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241320"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304241320"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304241320"}]},"ts":"1676304241320"} 2023-02-13 16:04:01,321 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241320"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304241320"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304241320"}]},"ts":"1676304241320"} 2023-02-13 16:04:01,320 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676304241320"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304241320"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304241320"}]},"ts":"1676304241320"} 2023-02-13 16:04:01,320 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=de2fe8e662905cab2bf9f0dcf34e33f8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:01,320 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241320"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304241320"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304241320"}]},"ts":"1676304241320"} 2023-02-13 16:04:01,321 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676304241320"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304241320"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304241320"}]},"ts":"1676304241320"} 2023-02-13 16:04:01,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=35, state=RUNNABLE; CloseRegionProcedure e48a3cd06e30e6169b9bc9b965f5a719, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:04:01,322 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=38, state=RUNNABLE; CloseRegionProcedure 5823fbf2e700d0694fccfba5d8c7a6a1, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:04:01,323 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=34, state=RUNNABLE; CloseRegionProcedure addfc8eb7c96bb556468ea56ec55a173, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:04:01,324 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=37, state=RUNNABLE; CloseRegionProcedure 8646a3d3d530cc58099faa6abb729dd2, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:04:01,324 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=42, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4829240dd0e63b15968d87bd3e5fc003, UNASSIGN 2023-02-13 16:04:01,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=48, ppid=43, state=RUNNABLE; CloseRegionProcedure de2fe8e662905cab2bf9f0dcf34e33f8, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:04:01,325 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4c0a4179cf2b281d1840291f3c74db3, UNASSIGN 2023-02-13 16:04:01,325 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=4829240dd0e63b15968d87bd3e5fc003, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:01,325 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5ad9f94449126a32bbc91ae22c608359, UNASSIGN 2023-02-13 16:04:01,325 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241325"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304241325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304241325"}]},"ts":"1676304241325"} 2023-02-13 16:04:01,326 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e4c0a4179cf2b281d1840291f3c74db3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:01,326 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304241326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304241326"}]},"ts":"1676304241326"} 2023-02-13 16:04:01,326 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5ad9f94449126a32bbc91ae22c608359, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:01,326 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241326"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304241326"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304241326"}]},"ts":"1676304241326"} 2023-02-13 16:04:01,327 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=39, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3e43fa2c94bcbf2834d8f3df44221897, UNASSIGN 2023-02-13 16:04:01,327 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=49, ppid=42, state=RUNNABLE; CloseRegionProcedure 4829240dd0e63b15968d87bd3e5fc003, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:04:01,327 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=33, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d49c481402c6df23fd723c27097ad156, UNASSIGN 2023-02-13 16:04:01,327 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=3e43fa2c94bcbf2834d8f3df44221897, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:01,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=41, state=RUNNABLE; CloseRegionProcedure e4c0a4179cf2b281d1840291f3c74db3, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:04:01,328 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241327"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304241327"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304241327"}]},"ts":"1676304241327"} 2023-02-13 16:04:01,328 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d49c481402c6df23fd723c27097ad156, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:01,328 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676304237695.d49c481402c6df23fd723c27097ad156.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304241328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304241328"}]},"ts":"1676304241328"} 2023-02-13 16:04:01,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=40, state=RUNNABLE; CloseRegionProcedure 5ad9f94449126a32bbc91ae22c608359, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:04:01,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=39, state=RUNNABLE; CloseRegionProcedure 3e43fa2c94bcbf2834d8f3df44221897, server=jenkins-hbase4.apache.org,45019,1676304236491}] 2023-02-13 16:04:01,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=36, state=RUNNABLE; CloseRegionProcedure d49c481402c6df23fd723c27097ad156, server=jenkins-hbase4.apache.org,44631,1676304236460}] 2023-02-13 16:04:01,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 16:04:01,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:04:01,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e48a3cd06e30e6169b9bc9b965f5a719, disabling compactions & flushes 2023-02-13 16:04:01,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:01,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:01,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. after waiting 0 ms 2023-02-13 16:04:01,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:01,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:04:01,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 8646a3d3d530cc58099faa6abb729dd2, disabling compactions & flushes 2023-02-13 16:04:01,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:01,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:01,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. after waiting 0 ms 2023-02-13 16:04:01,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:01,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:01,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:01,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719. 2023-02-13 16:04:01,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e48a3cd06e30e6169b9bc9b965f5a719: Waiting for close lock at 1676304241474Running coprocessor pre-close hooks at 1676304241474Disabling compacts and flushes for region at 1676304241474Disabling writes for close at 1676304241475 (+1 ms)Writing region close event to WAL at 1676304241476 (+1 ms)Running coprocessor post-close hooks at 1676304241479 (+3 ms)Closed at 1676304241480 (+1 ms) 2023-02-13 16:04:01,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2. 2023-02-13 16:04:01,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 8646a3d3d530cc58099faa6abb729dd2: Waiting for close lock at 1676304241475Running coprocessor pre-close hooks at 1676304241475Disabling compacts and flushes for region at 1676304241475Disabling writes for close at 1676304241475Writing region close event to WAL at 1676304241476 (+1 ms)Running coprocessor post-close hooks at 1676304241480 (+4 ms)Closed at 1676304241481 (+1 ms) 2023-02-13 16:04:01,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:04:01,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:04:01,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5ad9f94449126a32bbc91ae22c608359, disabling compactions & flushes 2023-02-13 16:04:01,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:01,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:01,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. after waiting 0 ms 2023-02-13 16:04:01,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:01,483 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=35 updating hbase:meta row=e48a3cd06e30e6169b9bc9b965f5a719, regionState=CLOSED 2023-02-13 16:04:01,483 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241483"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304241483"}]},"ts":"1676304241483"} 2023-02-13 16:04:01,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:04:01,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:04:01,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 3e43fa2c94bcbf2834d8f3df44221897, disabling compactions & flushes 2023-02-13 16:04:01,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:01,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:01,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. after waiting 0 ms 2023-02-13 16:04:01,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:01,484 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=8646a3d3d530cc58099faa6abb729dd2, regionState=CLOSED 2023-02-13 16:04:01,484 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241484"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304241484"}]},"ts":"1676304241484"} 2023-02-13 16:04:01,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=35 2023-02-13 16:04:01,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=35, state=SUCCESS; CloseRegionProcedure e48a3cd06e30e6169b9bc9b965f5a719, server=jenkins-hbase4.apache.org,44631,1676304236460 in 163 msec 2023-02-13 16:04:01,487 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=37 2023-02-13 16:04:01,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=37, state=SUCCESS; CloseRegionProcedure 8646a3d3d530cc58099faa6abb729dd2, server=jenkins-hbase4.apache.org,45019,1676304236491 in 162 msec 2023-02-13 16:04:01,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e48a3cd06e30e6169b9bc9b965f5a719, UNASSIGN in 168 msec 2023-02-13 16:04:01,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=8646a3d3d530cc58099faa6abb729dd2, UNASSIGN in 170 msec 2023-02-13 16:04:01,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:01,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359. 2023-02-13 16:04:01,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5ad9f94449126a32bbc91ae22c608359: Waiting for close lock at 1676304241483Running coprocessor pre-close hooks at 1676304241483Disabling compacts and flushes for region at 1676304241483Disabling writes for close at 1676304241483Writing region close event to WAL at 1676304241486 (+3 ms)Running coprocessor post-close hooks at 1676304241490 (+4 ms)Closed at 1676304241490 2023-02-13 16:04:01,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:01,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897. 2023-02-13 16:04:01,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 3e43fa2c94bcbf2834d8f3df44221897: Waiting for close lock at 1676304241483Running coprocessor pre-close hooks at 1676304241483Disabling compacts and flushes for region at 1676304241483Disabling writes for close at 1676304241484 (+1 ms)Writing region close event to WAL at 1676304241487 (+3 ms)Running coprocessor post-close hooks at 1676304241491 (+4 ms)Closed at 1676304241492 (+1 ms) 2023-02-13 16:04:01,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:04:01,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d49c481402c6df23fd723c27097ad156 2023-02-13 16:04:01,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d49c481402c6df23fd723c27097ad156, disabling compactions & flushes 2023-02-13 16:04:01,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:01,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:01,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. after waiting 0 ms 2023-02-13 16:04:01,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:01,493 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5ad9f94449126a32bbc91ae22c608359, regionState=CLOSED 2023-02-13 16:04:01,493 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304241493"}]},"ts":"1676304241493"} 2023-02-13 16:04:01,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:04:01,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:04:01,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing addfc8eb7c96bb556468ea56ec55a173, disabling compactions & flushes 2023-02-13 16:04:01,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:01,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:01,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. after waiting 0 ms 2023-02-13 16:04:01,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:01,493 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=39 updating hbase:meta row=3e43fa2c94bcbf2834d8f3df44221897, regionState=CLOSED 2023-02-13 16:04:01,493 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304241493"}]},"ts":"1676304241493"} 2023-02-13 16:04:01,496 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=40 2023-02-13 16:04:01,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=40, state=SUCCESS; CloseRegionProcedure 5ad9f94449126a32bbc91ae22c608359, server=jenkins-hbase4.apache.org,44631,1676304236460 in 167 msec 2023-02-13 16:04:01,500 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=39 2023-02-13 16:04:01,500 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=39, state=SUCCESS; CloseRegionProcedure 3e43fa2c94bcbf2834d8f3df44221897, server=jenkins-hbase4.apache.org,45019,1676304236491 in 167 msec 2023-02-13 16:04:01,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5ad9f94449126a32bbc91ae22c608359, UNASSIGN in 179 msec 2023-02-13 16:04:01,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:01,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 16:04:01,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156. 2023-02-13 16:04:01,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d49c481402c6df23fd723c27097ad156: Waiting for close lock at 1676304241492Running coprocessor pre-close hooks at 1676304241492Disabling compacts and flushes for region at 1676304241492Disabling writes for close at 1676304241492Writing region close event to WAL at 1676304241494 (+2 ms)Running coprocessor post-close hooks at 1676304241501 (+7 ms)Closed at 1676304241502 (+1 ms) 2023-02-13 16:04:01,502 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=3e43fa2c94bcbf2834d8f3df44221897, UNASSIGN in 182 msec 2023-02-13 16:04:01,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173. 2023-02-13 16:04:01,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for addfc8eb7c96bb556468ea56ec55a173: Waiting for close lock at 1676304241493Running coprocessor pre-close hooks at 1676304241493Disabling compacts and flushes for region at 1676304241493Disabling writes for close at 1676304241493Writing region close event to WAL at 1676304241494 (+1 ms)Running coprocessor post-close hooks at 1676304241502 (+8 ms)Closed at 1676304241503 (+1 ms) 2023-02-13 16:04:01,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d49c481402c6df23fd723c27097ad156 2023-02-13 16:04:01,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:04:01,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 5823fbf2e700d0694fccfba5d8c7a6a1, disabling compactions & flushes 2023-02-13 16:04:01,504 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:01,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:01,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. after waiting 0 ms 2023-02-13 16:04:01,505 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d49c481402c6df23fd723c27097ad156, regionState=CLOSED 2023-02-13 16:04:01,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:01,505 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676304237695.d49c481402c6df23fd723c27097ad156.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241505"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304241505"}]},"ts":"1676304241505"} 2023-02-13 16:04:01,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:04:01,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:04:01,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing de2fe8e662905cab2bf9f0dcf34e33f8, disabling compactions & flushes 2023-02-13 16:04:01,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:01,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:01,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. after waiting 0 ms 2023-02-13 16:04:01,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:01,506 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=34 updating hbase:meta row=addfc8eb7c96bb556468ea56ec55a173, regionState=CLOSED 2023-02-13 16:04:01,507 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676304241506"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304241506"}]},"ts":"1676304241506"} 2023-02-13 16:04:01,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=36 2023-02-13 16:04:01,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=36, state=SUCCESS; CloseRegionProcedure d49c481402c6df23fd723c27097ad156, server=jenkins-hbase4.apache.org,44631,1676304236460 in 174 msec 2023-02-13 16:04:01,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=34 2023-02-13 16:04:01,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-13 16:04:01,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=d49c481402c6df23fd723c27097ad156, UNASSIGN in 191 msec 2023-02-13 16:04:01,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=34, state=SUCCESS; CloseRegionProcedure addfc8eb7c96bb556468ea56ec55a173, server=jenkins-hbase4.apache.org,45019,1676304236491 in 185 msec 2023-02-13 16:04:01,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:01,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8. 2023-02-13 16:04:01,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for de2fe8e662905cab2bf9f0dcf34e33f8: Waiting for close lock at 1676304241506Running coprocessor pre-close hooks at 1676304241506Disabling compacts and flushes for region at 1676304241506Disabling writes for close at 1676304241506Writing region close event to WAL at 1676304241506Running coprocessor post-close hooks at 1676304241511 (+5 ms)Closed at 1676304241512 (+1 ms) 2023-02-13 16:04:01,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1. 2023-02-13 16:04:01,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 5823fbf2e700d0694fccfba5d8c7a6a1: Waiting for close lock at 1676304241504Running coprocessor pre-close hooks at 1676304241504Disabling compacts and flushes for region at 1676304241504Disabling writes for close at 1676304241505 (+1 ms)Writing region close event to WAL at 1676304241506 (+1 ms)Running coprocessor post-close hooks at 1676304241512 (+6 ms)Closed at 1676304241513 (+1 ms) 2023-02-13 16:04:01,513 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=addfc8eb7c96bb556468ea56ec55a173, UNASSIGN in 192 msec 2023-02-13 16:04:01,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:04:01,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:04:01,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing e4c0a4179cf2b281d1840291f3c74db3, disabling compactions & flushes 2023-02-13 16:04:01,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:01,514 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=de2fe8e662905cab2bf9f0dcf34e33f8, regionState=CLOSED 2023-02-13 16:04:01,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:01,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. after waiting 0 ms 2023-02-13 16:04:01,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:01,514 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.","families":{"info":[{"qualifier":"regioninfo","vlen":71,"tag":[],"timestamp":"1676304241514"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304241514"}]},"ts":"1676304241514"} 2023-02-13 16:04:01,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:04:01,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:04:01,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 4829240dd0e63b15968d87bd3e5fc003, disabling compactions & flushes 2023-02-13 16:04:01,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:01,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:01,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. after waiting 0 ms 2023-02-13 16:04:01,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:01,515 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=5823fbf2e700d0694fccfba5d8c7a6a1, regionState=CLOSED 2023-02-13 16:04:01,515 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304241515"}]},"ts":"1676304241515"} 2023-02-13 16:04:01,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=48, resume processing ppid=43 2023-02-13 16:04:01,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, ppid=43, state=SUCCESS; CloseRegionProcedure de2fe8e662905cab2bf9f0dcf34e33f8, server=jenkins-hbase4.apache.org,45019,1676304236491 in 192 msec 2023-02-13 16:04:01,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=38 2023-02-13 16:04:01,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=38, state=SUCCESS; CloseRegionProcedure 5823fbf2e700d0694fccfba5d8c7a6a1, server=jenkins-hbase4.apache.org,44631,1676304236460 in 195 msec 2023-02-13 16:04:01,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=de2fe8e662905cab2bf9f0dcf34e33f8, UNASSIGN in 200 msec 2023-02-13 16:04:01,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=5823fbf2e700d0694fccfba5d8c7a6a1, UNASSIGN in 201 msec 2023-02-13 16:04:01,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:01,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3. 2023-02-13 16:04:01,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for e4c0a4179cf2b281d1840291f3c74db3: Waiting for close lock at 1676304241514Running coprocessor pre-close hooks at 1676304241514Disabling compacts and flushes for region at 1676304241514Disabling writes for close at 1676304241514Writing region close event to WAL at 1676304241516 (+2 ms)Running coprocessor post-close hooks at 1676304241521 (+5 ms)Closed at 1676304241522 (+1 ms) 2023-02-13 16:04:01,524 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e4c0a4179cf2b281d1840291f3c74db3, regionState=CLOSED 2023-02-13 16:04:01,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:01,524 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241524"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304241524"}]},"ts":"1676304241524"} 2023-02-13 16:04:01,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003. 2023-02-13 16:04:01,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 4829240dd0e63b15968d87bd3e5fc003: Waiting for close lock at 1676304241515Running coprocessor pre-close hooks at 1676304241515Disabling compacts and flushes for region at 1676304241515Disabling writes for close at 1676304241515Writing region close event to WAL at 1676304241520 (+5 ms)Running coprocessor post-close hooks at 1676304241525 (+5 ms)Closed at 1676304241525 2023-02-13 16:04:01,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:04:01,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:04:01,527 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=42 updating hbase:meta row=4829240dd0e63b15968d87bd3e5fc003, regionState=CLOSED 2023-02-13 16:04:01,527 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.","families":{"info":[{"qualifier":"regioninfo","vlen":74,"tag":[],"timestamp":"1676304241527"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304241527"}]},"ts":"1676304241527"} 2023-02-13 16:04:01,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=41 2023-02-13 16:04:01,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=41, state=SUCCESS; CloseRegionProcedure e4c0a4179cf2b281d1840291f3c74db3, server=jenkins-hbase4.apache.org,45019,1676304236491 in 199 msec 2023-02-13 16:04:01,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=e4c0a4179cf2b281d1840291f3c74db3, UNASSIGN in 210 msec 2023-02-13 16:04:01,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=49, resume processing ppid=42 2023-02-13 16:04:01,530 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, ppid=42, state=SUCCESS; CloseRegionProcedure 4829240dd0e63b15968d87bd3e5fc003, server=jenkins-hbase4.apache.org,44631,1676304236460 in 201 msec 2023-02-13 16:04:01,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=42, resume processing ppid=33 2023-02-13 16:04:01,531 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, ppid=33, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceMultiRegion, region=4829240dd0e63b15968d87bd3e5fc003, UNASSIGN in 212 msec 2023-02-13 16:04:01,531 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304241531"}]},"ts":"1676304241531"} 2023-02-13 16:04:01,532 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceMultiRegion, state=DISABLED in hbase:meta 2023-02-13 16:04:01,534 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceMultiRegion to state=DISABLED 2023-02-13 16:04:01,536 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceMultiRegion in 224 msec 2023-02-13 16:04:01,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1227): Checking to see if procedure is done pid=33 2023-02-13 16:04:01,618 INFO [Listener at localhost/35815] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 33 completed 2023-02-13 16:04:01,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,621 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=54, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,622 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=54, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 16:04:01,633 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:04:01,633 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156 2023-02-13 16:04:01,633 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:04:01,633 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:04:01,633 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:04:01,633 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:04:01,633 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:04:01,633 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:04:01,686 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/recovered.edits] 2023-02-13 16:04:01,689 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/recovered.edits] 2023-02-13 16:04:01,690 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/recovered.edits] 2023-02-13 16:04:01,690 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/f1, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/f2, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/recovered.edits] 2023-02-13 16:04:01,691 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/recovered.edits] 2023-02-13 16:04:01,692 DEBUG [HFileArchiver-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/recovered.edits] 2023-02-13 16:04:01,692 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/recovered.edits] 2023-02-13 16:04:01,693 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/recovered.edits] 2023-02-13 16:04:01,698 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/b0ee3425c7b64808bb1f5395ee211173 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/b0ee3425c7b64808bb1f5395ee211173 2023-02-13 16:04:01,698 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/0405118835f340b8b62444cdaee73f0f to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/0405118835f340b8b62444cdaee73f0f 2023-02-13 16:04:01,698 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/8762baf641ec44a8a20c5016de367b22 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/8762baf641ec44a8a20c5016de367b22 2023-02-13 16:04:01,700 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/87bb14b94a4b43e88a1074e5cac33f2b to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/87bb14b94a4b43e88a1074e5cac33f2b 2023-02-13 16:04:01,701 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/92bd3c66608b4081b1773d604e6f4c84 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/92bd3c66608b4081b1773d604e6f4c84 2023-02-13 16:04:01,702 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/5e4b73f376b24d00becd6f29ff8d857b to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/5e4b73f376b24d00becd6f29ff8d857b 2023-02-13 16:04:01,702 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/c85fbbf3f9f448ac980d7cf02301dab3 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f1/c85fbbf3f9f448ac980d7cf02301dab3 2023-02-13 16:04:01,702 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/bc1af94d13e745719e68c0caf57e3fd0 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f1/bc1af94d13e745719e68c0caf57e3fd0 2023-02-13 16:04:01,703 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/e1f5078546ff4bdb840190d21d194430 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f1/e1f5078546ff4bdb840190d21d194430 2023-02-13 16:04:01,703 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/fb698fea18d54ab6806cab5a373a2924 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f1/fb698fea18d54ab6806cab5a373a2924 2023-02-13 16:04:01,703 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/64e8681caa6c454493aa938dea17d981 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/64e8681caa6c454493aa938dea17d981 2023-02-13 16:04:01,703 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/recovered.edits/6.seqid to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173/recovered.edits/6.seqid 2023-02-13 16:04:01,703 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/c4c10f1635124df6be24397eec786ae3 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f1/c4c10f1635124df6be24397eec786ae3 2023-02-13 16:04:01,705 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/e47e809b3bc54d1f852df0979fc57464 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f1/e47e809b3bc54d1f852df0979fc57464 2023-02-13 16:04:01,705 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/addfc8eb7c96bb556468ea56ec55a173 2023-02-13 16:04:01,705 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:04:01,706 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/e40c5ba4af0b4f04b08dbf71c09fc8d1 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f1/e40c5ba4af0b4f04b08dbf71c09fc8d1 2023-02-13 16:04:01,708 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/099d7c2f082c49a59ab274fd7c32b65d to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/099d7c2f082c49a59ab274fd7c32b65d 2023-02-13 16:04:01,708 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/8e11957abdbe4ac4be4b022f5245a16e to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/8e11957abdbe4ac4be4b022f5245a16e 2023-02-13 16:04:01,709 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/c0ac1c35e7dd409795a56ad35a360b76 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/c0ac1c35e7dd409795a56ad35a360b76 2023-02-13 16:04:01,709 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/1be7e12791994bfeac71865d982e7394 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/1be7e12791994bfeac71865d982e7394 2023-02-13 16:04:01,710 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/30497ac32020422ba2405a46652ab2be to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/30497ac32020422ba2405a46652ab2be 2023-02-13 16:04:01,711 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/9ccb05b3b442436cb9ed9aa3f6839c82 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/f2/9ccb05b3b442436cb9ed9aa3f6839c82 2023-02-13 16:04:01,711 DEBUG [HFileArchiver-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/recovered.edits] 2023-02-13 16:04:01,711 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/c9d0da46d6dc4f9cb89b4e806027bfe5 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/f2/c9d0da46d6dc4f9cb89b4e806027bfe5 2023-02-13 16:04:01,711 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/482510d1461843a9a9b5dc87172c9c97 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/482510d1461843a9a9b5dc87172c9c97 2023-02-13 16:04:01,712 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/f8a2172f07534b6dbafaf5559b558a5e to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/f2/f8a2172f07534b6dbafaf5559b558a5e 2023-02-13 16:04:01,712 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/279a84e4cdcf4ffb9651a5cb33ad0654 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/279a84e4cdcf4ffb9651a5cb33ad0654 2023-02-13 16:04:01,714 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/5d87d36613df4473872bf25579e0484a to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/f2/5d87d36613df4473872bf25579e0484a 2023-02-13 16:04:01,714 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/f985748a6ed04ab4b8211088782c2082 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/f2/f985748a6ed04ab4b8211088782c2082 2023-02-13 16:04:01,715 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/41d66ca00e0f4b32859d84054a34b629 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/f2/41d66ca00e0f4b32859d84054a34b629 2023-02-13 16:04:01,715 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/df41183563574dfbaf3c9edae123c0ee to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/f2/df41183563574dfbaf3c9edae123c0ee 2023-02-13 16:04:01,721 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/recovered.edits/12.seqid to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156/recovered.edits/12.seqid 2023-02-13 16:04:01,722 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/d49c481402c6df23fd723c27097ad156 2023-02-13 16:04:01,722 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:04:01,722 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/recovered.edits/12.seqid to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1/recovered.edits/12.seqid 2023-02-13 16:04:01,722 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/recovered.edits/12.seqid to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359/recovered.edits/12.seqid 2023-02-13 16:04:01,723 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/4b2cbc3fa8bb4f32bf9fd6278dae1b03 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/4b2cbc3fa8bb4f32bf9fd6278dae1b03 2023-02-13 16:04:01,723 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5823fbf2e700d0694fccfba5d8c7a6a1 2023-02-13 16:04:01,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 16:04:01,725 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/recovered.edits/12.seqid to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719/recovered.edits/12.seqid 2023-02-13 16:04:01,725 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/5ad9f94449126a32bbc91ae22c608359 2023-02-13 16:04:01,725 DEBUG [HFileArchiver-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/f1, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/f2, FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/recovered.edits] 2023-02-13 16:04:01,726 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/recovered.edits/12.seqid to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2/recovered.edits/12.seqid 2023-02-13 16:04:01,726 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e48a3cd06e30e6169b9bc9b965f5a719 2023-02-13 16:04:01,726 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/c6558eca56cf474395621be195dc0a89 to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f1/c6558eca56cf474395621be195dc0a89 2023-02-13 16:04:01,726 DEBUG [HFileArchiver-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/recovered.edits/12.seqid to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3/recovered.edits/12.seqid 2023-02-13 16:04:01,726 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/8646a3d3d530cc58099faa6abb729dd2 2023-02-13 16:04:01,727 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/recovered.edits/12.seqid to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897/recovered.edits/12.seqid 2023-02-13 16:04:01,727 DEBUG [HFileArchiver-4] backup.HFileArchiver(596): Deleted hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/e4c0a4179cf2b281d1840291f3c74db3 2023-02-13 16:04:01,728 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/3e43fa2c94bcbf2834d8f3df44221897 2023-02-13 16:04:01,730 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/1bfdd8d806f34532bbce98aa646d663f to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/1bfdd8d806f34532bbce98aa646d663f 2023-02-13 16:04:01,732 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/4e30134099ed49af9daa9f06b6a8b98f to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/f2/4e30134099ed49af9daa9f06b6a8b98f 2023-02-13 16:04:01,732 DEBUG [HFileArchiver-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/recovered.edits/6.seqid to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8/recovered.edits/6.seqid 2023-02-13 16:04:01,733 DEBUG [HFileArchiver-1] backup.HFileArchiver(596): Deleted hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/de2fe8e662905cab2bf9f0dcf34e33f8 2023-02-13 16:04:01,734 DEBUG [HFileArchiver-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/recovered.edits/12.seqid to hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/archive/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003/recovered.edits/12.seqid 2023-02-13 16:04:01,734 DEBUG [HFileArchiver-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/.tmp/data/default/testWithMockedMapReduceMultiRegion/4829240dd0e63b15968d87bd3e5fc003 2023-02-13 16:04:01,734 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceMultiRegion regions 2023-02-13 16:04:01,736 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=54, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,739 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 10 rows of testWithMockedMapReduceMultiRegion from hbase:meta 2023-02-13 16:04:01,741 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceMultiRegion' descriptor. 2023-02-13 16:04:01,741 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=54, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,741 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceMultiRegion' from region states. 2023-02-13 16:04:01,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304241741"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304241741"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,d\\x84\\x84,1676304237695.d49c481402c6df23fd723c27097ad156.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304241741"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,g\\xA7\\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304241741"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,j\\xCA\\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304241741"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,m\\xED\\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304241741"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,q\\x11\\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304241741"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304241741"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304241741"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,742 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304241741"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,744 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 10 regions from META 2023-02-13 16:04:01,744 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => addfc8eb7c96bb556468ea56ec55a173, NAME => 'testWithMockedMapReduceMultiRegion,,1676304237695.addfc8eb7c96bb556468ea56ec55a173.', STARTKEY => '', ENDKEY => 'aaa'}, {ENCODED => e48a3cd06e30e6169b9bc9b965f5a719, NAME => 'testWithMockedMapReduceMultiRegion,aaa,1676304237695.e48a3cd06e30e6169b9bc9b965f5a719.', STARTKEY => 'aaa', ENDKEY => 'd\x84\x84'}, {ENCODED => d49c481402c6df23fd723c27097ad156, NAME => 'testWithMockedMapReduceMultiRegion,d\x84\x84,1676304237695.d49c481402c6df23fd723c27097ad156.', STARTKEY => 'd\x84\x84', ENDKEY => 'g\xA7\xA7'}, {ENCODED => 8646a3d3d530cc58099faa6abb729dd2, NAME => 'testWithMockedMapReduceMultiRegion,g\xA7\xA7,1676304237695.8646a3d3d530cc58099faa6abb729dd2.', STARTKEY => 'g\xA7\xA7', ENDKEY => 'j\xCA\xCA'}, {ENCODED => 5823fbf2e700d0694fccfba5d8c7a6a1, NAME => 'testWithMockedMapReduceMultiRegion,j\xCA\xCA,1676304237695.5823fbf2e700d0694fccfba5d8c7a6a1.', STARTKEY => 'j\xCA\xCA', ENDKEY => 'm\xED\xED'}, {ENCODED => 3e43fa2c94bcbf2834d8f3df44221897, NAME => 'testWithMockedMapReduceMultiRegion,m\xED\xED,1676304237695.3e43fa2c94bcbf2834d8f3df44221897.', STARTKEY => 'm\xED\xED', ENDKEY => 'q\x11\x10'}, {ENCODED => 5ad9f94449126a32bbc91ae22c608359, NAME => 'testWithMockedMapReduceMultiRegion,q\x11\x10,1676304237695.5ad9f94449126a32bbc91ae22c608359.', STARTKEY => 'q\x11\x10', ENDKEY => 't43'}, {ENCODED => e4c0a4179cf2b281d1840291f3c74db3, NAME => 'testWithMockedMapReduceMultiRegion,t43,1676304237695.e4c0a4179cf2b281d1840291f3c74db3.', STARTKEY => 't43', ENDKEY => 'wWV'}, {ENCODED => 4829240dd0e63b15968d87bd3e5fc003, NAME => 'testWithMockedMapReduceMultiRegion,wWV,1676304237695.4829240dd0e63b15968d87bd3e5fc003.', STARTKEY => 'wWV', ENDKEY => 'zz{'}, {ENCODED => de2fe8e662905cab2bf9f0dcf34e33f8, NAME => 'testWithMockedMapReduceMultiRegion,zz{,1676304237695.de2fe8e662905cab2bf9f0dcf34e33f8.', STARTKEY => 'zz{', ENDKEY => ''}] 2023-02-13 16:04:01,744 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceMultiRegion' as deleted. 2023-02-13 16:04:01,744 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceMultiRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676304241744"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:01,746 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceMultiRegion state from META 2023-02-13 16:04:01,747 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=54, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion 2023-02-13 16:04:01,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceMultiRegion in 128 msec 2023-02-13 16:04:01,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39489] master.MasterRpcServices(1227): Checking to see if procedure is done pid=54 2023-02-13 16:04:01,925 INFO [Listener at localhost/35815] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceMultiRegion, procId: 54 completed 2023-02-13 16:04:01,925 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 16:04:01,925 INFO [Listener at localhost/35815] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 16:04:01,926 DEBUG [Listener at localhost/35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x410c54c0 to 127.0.0.1:62288 2023-02-13 16:04:01,926 DEBUG [Listener at localhost/35815] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:01,926 DEBUG [Listener at localhost/35815] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 16:04:01,926 DEBUG [Listener at localhost/35815] util.JVMClusterUtil(257): Found active master hash=1571475647, stopped=false 2023-02-13 16:04:01,926 INFO [Listener at localhost/35815] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39489,1676304236409 2023-02-13 16:04:01,928 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:01,928 INFO [Listener at localhost/35815] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 16:04:01,928 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:01,929 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:01,928 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:01,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:01,930 DEBUG [Listener at localhost/35815] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b5d8a96 to 127.0.0.1:62288 2023-02-13 16:04:01,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:01,930 DEBUG [Listener at localhost/35815] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:01,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:01,930 INFO [Listener at localhost/35815] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44631,1676304236460' ***** 2023-02-13 16:04:01,931 INFO [Listener at localhost/35815] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:04:01,931 INFO [Listener at localhost/35815] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45019,1676304236491' ***** 2023-02-13 16:04:01,931 INFO [Listener at localhost/35815] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:04:01,931 INFO [RS:0;jenkins-hbase4:44631] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:04:01,931 INFO [RS:0;jenkins-hbase4:44631] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:04:01,931 INFO [RS:1;jenkins-hbase4:45019] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:04:01,931 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:04:01,931 INFO [RS:1;jenkins-hbase4:45019] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:04:01,931 INFO [RS:0;jenkins-hbase4:44631] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:04:01,932 INFO [RS:1;jenkins-hbase4:45019] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:04:01,933 INFO [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(3304): Received CLOSE for ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:04:01,933 INFO [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:01,933 INFO [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:01,933 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:04:01,933 DEBUG [RS:1;jenkins-hbase4:45019] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ea41aed to 127.0.0.1:62288 2023-02-13 16:04:01,934 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 16:04:01,933 DEBUG [RS:0;jenkins-hbase4:44631] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c737fe2 to 127.0.0.1:62288 2023-02-13 16:04:01,934 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 16:04:01,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing ed446ea485d34e750141848e0edd7d4c, disabling compactions & flushes 2023-02-13 16:04:01,934 DEBUG [RS:1;jenkins-hbase4:45019] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:01,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:04:01,935 DEBUG [RS:0;jenkins-hbase4:44631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:01,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:04:01,935 INFO [RS:1;jenkins-hbase4:45019] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:04:01,935 INFO [RS:1;jenkins-hbase4:45019] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:04:01,935 INFO [RS:1;jenkins-hbase4:45019] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:04:01,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. after waiting 0 ms 2023-02-13 16:04:01,935 INFO [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 16:04:01,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:04:01,935 INFO [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 16:04:01,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing ed446ea485d34e750141848e0edd7d4c 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 16:04:01,935 DEBUG [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1479): Online Regions={ed446ea485d34e750141848e0edd7d4c=hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c.} 2023-02-13 16:04:01,935 INFO [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 16:04:01,935 DEBUG [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1505): Waiting on ed446ea485d34e750141848e0edd7d4c 2023-02-13 16:04:01,935 DEBUG [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 16:04:01,937 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 16:04:01,937 DEBUG [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 16:04:01,937 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 16:04:01,937 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:04:01,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:04:01,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:04:01,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:04:01,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:04:01,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=28.36 KB heapSize=44.48 KB 2023-02-13 16:04:01,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=25.73 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/.tmp/info/eab735b50379461b9092a3691afde091 2023-02-13 16:04:01,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c/.tmp/info/661c43db0f02486f8caf5a0c39a4c9f8 2023-02-13 16:04:01,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eab735b50379461b9092a3691afde091 2023-02-13 16:04:01,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c/.tmp/info/661c43db0f02486f8caf5a0c39a4c9f8 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c/info/661c43db0f02486f8caf5a0c39a4c9f8 2023-02-13 16:04:01,961 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c/info/661c43db0f02486f8caf5a0c39a4c9f8, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 16:04:01,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ed446ea485d34e750141848e0edd7d4c in 27ms, sequenceid=6, compaction requested=false 2023-02-13 16:04:01,973 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.14 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/.tmp/rep_barrier/9503c899891140778d9394f9c3f7bc47 2023-02-13 16:04:01,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/namespace/ed446ea485d34e750141848e0edd7d4c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 16:04:01,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:04:01,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for ed446ea485d34e750141848e0edd7d4c: Waiting for close lock at 1676304241934Running coprocessor pre-close hooks at 1676304241934Disabling compacts and flushes for region at 1676304241934Disabling writes for close at 1676304241935 (+1 ms)Obtaining lock to block concurrent updates at 1676304241935Preparing flush snapshotting stores in ed446ea485d34e750141848e0edd7d4c at 1676304241935Finished memstore snapshotting hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676304241937 (+2 ms)Flushing stores of hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. at 1676304241938 (+1 ms)Flushing ed446ea485d34e750141848e0edd7d4c/info: creating writer at 1676304241938Flushing ed446ea485d34e750141848e0edd7d4c/info: appending metadata at 1676304241940 (+2 ms)Flushing ed446ea485d34e750141848e0edd7d4c/info: closing flushed file at 1676304241940Flushing ed446ea485d34e750141848e0edd7d4c/info: reopening flushed file at 1676304241957 (+17 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for ed446ea485d34e750141848e0edd7d4c in 27ms, sequenceid=6, compaction requested=false at 1676304241962 (+5 ms)Writing region close event to WAL at 1676304241970 (+8 ms)Running coprocessor post-close hooks at 1676304241975 (+5 ms)Closed at 1676304241976 (+1 ms) 2023-02-13 16:04:01,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676304237131.ed446ea485d34e750141848e0edd7d4c. 2023-02-13 16:04:01,978 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9503c899891140778d9394f9c3f7bc47 2023-02-13 16:04:01,986 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:01,986 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:01,991 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.49 KB at sequenceid=57 (bloomFilter=false), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/.tmp/table/53a38c6dc9f644afbafe109c97f8b803 2023-02-13 16:04:01,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53a38c6dc9f644afbafe109c97f8b803 2023-02-13 16:04:01,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/.tmp/info/eab735b50379461b9092a3691afde091 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/info/eab735b50379461b9092a3691afde091 2023-02-13 16:04:02,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eab735b50379461b9092a3691afde091 2023-02-13 16:04:02,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/info/eab735b50379461b9092a3691afde091, entries=30, sequenceid=57, filesize=8.3 K 2023-02-13 16:04:02,001 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/.tmp/rep_barrier/9503c899891140778d9394f9c3f7bc47 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/rep_barrier/9503c899891140778d9394f9c3f7bc47 2023-02-13 16:04:02,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9503c899891140778d9394f9c3f7bc47 2023-02-13 16:04:02,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/rep_barrier/9503c899891140778d9394f9c3f7bc47, entries=10, sequenceid=57, filesize=6.1 K 2023-02-13 16:04:02,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/.tmp/table/53a38c6dc9f644afbafe109c97f8b803 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/table/53a38c6dc9f644afbafe109c97f8b803 2023-02-13 16:04:02,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53a38c6dc9f644afbafe109c97f8b803 2023-02-13 16:04:02,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/table/53a38c6dc9f644afbafe109c97f8b803, entries=13, sequenceid=57, filesize=6.1 K 2023-02-13 16:04:02,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 72ms, sequenceid=57, compaction requested=false 2023-02-13 16:04:02,014 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/data/hbase/meta/1588230740/recovered.edits/60.seqid, newMaxSeqId=60, maxSeqId=1 2023-02-13 16:04:02,014 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 16:04:02,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:02,015 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304241935Running coprocessor pre-close hooks at 1676304241935Disabling compacts and flushes for region at 1676304241935Disabling writes for close at 1676304241938 (+3 ms)Obtaining lock to block concurrent updates at 1676304241938Preparing flush snapshotting stores in 1588230740 at 1676304241938Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=29041, getHeapSize=45504, getOffHeapSize=0, getCellsCount=207 at 1676304241938Flushing stores of hbase:meta,,1.1588230740 at 1676304241938Flushing 1588230740/info: creating writer at 1676304241939 (+1 ms)Flushing 1588230740/info: appending metadata at 1676304241941 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676304241941Flushing 1588230740/rep_barrier: creating writer at 1676304241956 (+15 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676304241958 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676304241958Flushing 1588230740/table: creating writer at 1676304241978 (+20 ms)Flushing 1588230740/table: appending metadata at 1676304241980 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676304241980Flushing 1588230740/info: reopening flushed file at 1676304241996 (+16 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676304242001 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1676304242006 (+5 ms)Finished flush of dataSize ~28.36 KB/29041, heapSize ~44.44 KB/45504, currentSize=0 B/0 for 1588230740 in 72ms, sequenceid=57, compaction requested=false at 1676304242010 (+4 ms)Writing region close event to WAL at 1676304242011 (+1 ms)Running coprocessor post-close hooks at 1676304242014 (+3 ms)Closed at 1676304242015 (+1 ms) 2023-02-13 16:04:02,015 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:02,135 INFO [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44631,1676304236460; all regions closed. 2023-02-13 16:04:02,138 INFO [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45019,1676304236491; all regions closed. 2023-02-13 16:04:02,141 DEBUG [RS:0;jenkins-hbase4:44631] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/oldWALs 2023-02-13 16:04:02,141 INFO [RS:0;jenkins-hbase4:44631] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44631%2C1676304236460:(num 1676304237489) 2023-02-13 16:04:02,141 DEBUG [RS:0;jenkins-hbase4:44631] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:02,141 INFO [RS:0;jenkins-hbase4:44631] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:02,141 INFO [RS:0;jenkins-hbase4:44631] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 16:04:02,141 INFO [RS:0;jenkins-hbase4:44631] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:04:02,141 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:02,141 DEBUG [RS:1;jenkins-hbase4:45019] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/oldWALs 2023-02-13 16:04:02,142 INFO [RS:1;jenkins-hbase4:45019] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45019%2C1676304236491.meta:.meta(num 1676304237077) 2023-02-13 16:04:02,141 INFO [RS:0;jenkins-hbase4:44631] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:04:02,142 INFO [RS:0;jenkins-hbase4:44631] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:04:02,143 INFO [RS:0;jenkins-hbase4:44631] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44631 2023-02-13 16:04:02,144 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:02,144 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:02,145 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:02,147 DEBUG [RS:1;jenkins-hbase4:45019] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/oldWALs 2023-02-13 16:04:02,147 INFO [RS:1;jenkins-hbase4:45019] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45019%2C1676304236491:(num 1676304237867) 2023-02-13 16:04:02,147 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44631,1676304236460 2023-02-13 16:04:02,147 DEBUG [RS:1;jenkins-hbase4:45019] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:02,147 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:02,147 INFO [RS:1;jenkins-hbase4:45019] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:02,147 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44631,1676304236460] 2023-02-13 16:04:02,147 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44631,1676304236460; numProcessing=1 2023-02-13 16:04:02,147 INFO [RS:1;jenkins-hbase4:45019] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 16:04:02,148 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:02,149 INFO [RS:1;jenkins-hbase4:45019] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45019 2023-02-13 16:04:02,149 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44631,1676304236460 already deleted, retry=false 2023-02-13 16:04:02,149 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44631,1676304236460 expired; onlineServers=1 2023-02-13 16:04:02,151 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:02,151 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45019,1676304236491 2023-02-13 16:04:02,152 ERROR [Listener at localhost/35815-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5545c67f rejected from java.util.concurrent.ThreadPoolExecutor@517a480f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:02,153 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45019,1676304236491] 2023-02-13 16:04:02,153 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45019,1676304236491; numProcessing=2 2023-02-13 16:04:02,154 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45019,1676304236491 already deleted, retry=false 2023-02-13 16:04:02,154 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45019,1676304236491 expired; onlineServers=0 2023-02-13 16:04:02,154 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,39489,1676304236409' ***** 2023-02-13 16:04:02,154 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 16:04:02,155 DEBUG [M:0;jenkins-hbase4:39489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59955fd2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:04:02,155 INFO [M:0;jenkins-hbase4:39489] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,39489,1676304236409 2023-02-13 16:04:02,155 INFO [M:0;jenkins-hbase4:39489] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,39489,1676304236409; all regions closed. 2023-02-13 16:04:02,155 DEBUG [M:0;jenkins-hbase4:39489] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:02,155 DEBUG [M:0;jenkins-hbase4:39489] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 16:04:02,155 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 16:04:02,155 DEBUG [M:0;jenkins-hbase4:39489] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 16:04:02,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304236720] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304236720,5,FailOnTimeoutGroup] 2023-02-13 16:04:02,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304236717] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304236717,5,FailOnTimeoutGroup] 2023-02-13 16:04:02,155 INFO [M:0;jenkins-hbase4:39489] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 16:04:02,156 INFO [M:0;jenkins-hbase4:39489] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 16:04:02,156 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:02,156 INFO [M:0;jenkins-hbase4:39489] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 16:04:02,156 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:02,157 DEBUG [M:0;jenkins-hbase4:39489] master.HMaster(1502): Stopping service threads 2023-02-13 16:04:02,157 INFO [M:0;jenkins-hbase4:39489] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 16:04:02,157 ERROR [M:0;jenkins-hbase4:39489] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 16:04:02,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:02,157 INFO [M:0;jenkins-hbase4:39489] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 16:04:02,157 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 16:04:02,158 DEBUG [M:0;jenkins-hbase4:39489] zookeeper.ZKUtil(398): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 16:04:02,158 WARN [M:0;jenkins-hbase4:39489] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 16:04:02,158 INFO [M:0;jenkins-hbase4:39489] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 16:04:02,158 INFO [M:0;jenkins-hbase4:39489] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 16:04:02,158 DEBUG [M:0;jenkins-hbase4:39489] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:04:02,158 INFO [M:0;jenkins-hbase4:39489] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:02,158 DEBUG [M:0;jenkins-hbase4:39489] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:02,158 DEBUG [M:0;jenkins-hbase4:39489] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:04:02,158 DEBUG [M:0;jenkins-hbase4:39489] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:02,159 INFO [M:0;jenkins-hbase4:39489] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=167.12 KB heapSize=200.04 KB 2023-02-13 16:04:02,167 INFO [M:0;jenkins-hbase4:39489] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=167.12 KB at sequenceid=357 (bloomFilter=true), to=hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8bb2a5acdec843b08b8f25fb95726061 2023-02-13 16:04:02,170 DEBUG [M:0;jenkins-hbase4:39489] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8bb2a5acdec843b08b8f25fb95726061 as hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8bb2a5acdec843b08b8f25fb95726061 2023-02-13 16:04:02,174 INFO [M:0;jenkins-hbase4:39489] regionserver.HStore(1080): Added hdfs://localhost:45659/user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8bb2a5acdec843b08b8f25fb95726061, entries=53, sequenceid=357, filesize=10.7 K 2023-02-13 16:04:02,174 INFO [M:0;jenkins-hbase4:39489] regionserver.HRegion(2947): Finished flush of dataSize ~167.12 KB/171131, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false 2023-02-13 16:04:02,175 INFO [M:0;jenkins-hbase4:39489] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:02,175 DEBUG [M:0;jenkins-hbase4:39489] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304242158Disabling compacts and flushes for region at 1676304242158Disabling writes for close at 1676304242158Obtaining lock to block concurrent updates at 1676304242159 (+1 ms)Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676304242159Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=171131, getHeapSize=204824, getOffHeapSize=0, getCellsCount=442 at 1676304242159Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676304242160 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676304242160Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676304242162 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676304242162Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676304242171 (+9 ms)Finished flush of dataSize ~167.12 KB/171131, heapSize ~200.02 KB/204824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 16ms, sequenceid=357, compaction requested=false at 1676304242174 (+3 ms)Writing region close event to WAL at 1676304242175 (+1 ms)Closed at 1676304242175 2023-02-13 16:04:02,177 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/9cb24954-c56b-7059-ae91-73b69ba17f40/MasterData/WALs/jenkins-hbase4.apache.org,39489,1676304236409/jenkins-hbase4.apache.org%2C39489%2C1676304236409.1676304236634 not finished, retry = 0 2023-02-13 16:04:02,278 INFO [M:0;jenkins-hbase4:39489] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 16:04:02,278 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:02,279 INFO [M:0;jenkins-hbase4:39489] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39489 2023-02-13 16:04:02,283 DEBUG [M:0;jenkins-hbase4:39489] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39489,1676304236409 already deleted, retry=false 2023-02-13 16:04:02,330 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:02,330 INFO [RS:1;jenkins-hbase4:45019] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45019,1676304236491; zookeeper connection closed. 2023-02-13 16:04:02,330 ERROR [Listener at localhost/35815-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5e2b8c6f rejected from java.util.concurrent.ThreadPoolExecutor@517a480f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:02,330 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:45019-0x1004e6ca92b0002, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:02,330 ERROR [Listener at localhost/35815-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@269fc170 rejected from java.util.concurrent.ThreadPoolExecutor@517a480f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:02,330 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@603b8c68] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@603b8c68 2023-02-13 16:04:02,430 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:02,430 INFO [RS:0;jenkins-hbase4:44631] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44631,1676304236460; zookeeper connection closed. 2023-02-13 16:04:02,430 ERROR [Listener at localhost/35815-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@92f864c rejected from java.util.concurrent.ThreadPoolExecutor@d1013b1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:02,430 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): regionserver:44631-0x1004e6ca92b0001, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:02,430 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2e6a0ddb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2e6a0ddb 2023-02-13 16:04:02,430 ERROR [Listener at localhost/35815-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@c78cbc4 rejected from java.util.concurrent.ThreadPoolExecutor@d1013b1[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:02,431 INFO [Listener at localhost/35815] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 16:04:02,530 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:02,530 INFO [M:0;jenkins-hbase4:39489] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,39489,1676304236409; zookeeper connection closed. 2023-02-13 16:04:02,530 ERROR [Listener at localhost/35815-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@18593cfa rejected from java.util.concurrent.ThreadPoolExecutor@1c66bb29[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:02,531 DEBUG [Listener at localhost/35815-EventThread] zookeeper.ZKWatcher(600): master:39489-0x1004e6ca92b0000, quorum=127.0.0.1:62288, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:02,531 ERROR [Listener at localhost/35815-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@391839ac rejected from java.util.concurrent.ThreadPoolExecutor@1c66bb29[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 55] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:02,532 WARN [Listener at localhost/35815] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:04:02,535 INFO [Listener at localhost/35815] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:02,643 WARN [BP-1509783212-172.31.14.131-1676304235835 heartbeating to localhost/127.0.0.1:45659] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:04:02,644 WARN [BP-1509783212-172.31.14.131-1676304235835 heartbeating to localhost/127.0.0.1:45659] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1509783212-172.31.14.131-1676304235835 (Datanode Uuid 0f07c91d-11a3-4042-af14-51234206b64c) service to localhost/127.0.0.1:45659 2023-02-13 16:04:02,645 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/cluster_c00fdadd-e225-6c97-0371-7ad55931f5ad/dfs/data/data3/current/BP-1509783212-172.31.14.131-1676304235835] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:02,645 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/cluster_c00fdadd-e225-6c97-0371-7ad55931f5ad/dfs/data/data4/current/BP-1509783212-172.31.14.131-1676304235835] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:02,646 WARN [Listener at localhost/35815] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:04:02,649 INFO [Listener at localhost/35815] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:02,753 WARN [BP-1509783212-172.31.14.131-1676304235835 heartbeating to localhost/127.0.0.1:45659] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:04:02,753 WARN [BP-1509783212-172.31.14.131-1676304235835 heartbeating to localhost/127.0.0.1:45659] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1509783212-172.31.14.131-1676304235835 (Datanode Uuid dee96792-01d2-4b51-ab73-54f9a37aa9b6) service to localhost/127.0.0.1:45659 2023-02-13 16:04:02,753 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/cluster_c00fdadd-e225-6c97-0371-7ad55931f5ad/dfs/data/data1/current/BP-1509783212-172.31.14.131-1676304235835] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:02,754 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/cluster_c00fdadd-e225-6c97-0371-7ad55931f5ad/dfs/data/data2/current/BP-1509783212-172.31.14.131-1676304235835] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:02,767 INFO [Listener at localhost/35815] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:02,886 INFO [Listener at localhost/35815] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 16:04:02,922 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 16:04:02,937 INFO [Listener at localhost/35815] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceMultiRegion Thread=230 (was 180) Potentially hanging thread: Listener at localhost/35815.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-17-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,39489,1676304236409)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:45659 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-14-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:45659 from jenkins.hfs.7 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-15-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35815.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35815 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35815.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45659 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35815.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35815.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35815.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: nioEventLoopGroup-16-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:45659 from jenkins.hfs.6 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-14-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.6@localhost:45659 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-17-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.7@localhost:45659 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-12 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35815.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35815.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-13-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-10 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-16-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-11 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-15-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/35815.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: Listener at localhost/35815.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-12-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:45659 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-14-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-14-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-14-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-12-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-13-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=626 (was 565) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 313), ProcessCount=165 (was 165), AvailableMemoryMB=1499 (was 1636) 2023-02-13 16:04:02,947 INFO [Listener at localhost/35815] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=230, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=165, AvailableMemoryMB=1498 2023-02-13 16:04:02,957 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/hadoop.log.dir so I do NOT create it in target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72 2023-02-13 16:04:02,957 WARN [Listener at localhost/35815] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 16:04:02,957 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/hadoop.tmp.dir so I do NOT create it in target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72 2023-02-13 16:04:02,958 WARN [Listener at localhost/35815] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d016f8d9-c65f-8c8f-251f-9ef5f32f49ba/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 16:04:02,958 DEBUG [Listener at localhost/35815] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72 2023-02-13 16:04:02,958 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 16:04:02,958 INFO [Listener at localhost/35815] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/cluster_6bed958b-65c2-2ac9-acc3-76d137ef4961, deleteOnExit=true 2023-02-13 16:04:02,958 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 16:04:02,958 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/test.cache.data in system properties and HBase conf 2023-02-13 16:04:02,958 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 16:04:02,958 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/hadoop.log.dir in system properties and HBase conf 2023-02-13 16:04:02,958 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 16:04:02,958 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 16:04:02,958 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 16:04:02,959 DEBUG [Listener at localhost/35815] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 16:04:02,959 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:04:02,959 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:04:02,959 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 16:04:02,959 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:04:02,959 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 16:04:02,959 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 16:04:02,959 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:04:02,959 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:04:02,959 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 16:04:02,960 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/nfs.dump.dir in system properties and HBase conf 2023-02-13 16:04:02,960 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/java.io.tmpdir in system properties and HBase conf 2023-02-13 16:04:02,960 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:04:02,960 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 16:04:02,960 INFO [Listener at localhost/35815] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 16:04:02,964 WARN [Listener at localhost/35815] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:04:02,964 WARN [Listener at localhost/35815] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:04:03,004 WARN [Listener at localhost/35815] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-13 16:04:03,072 WARN [Listener at localhost/35815] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:04:03,074 INFO [Listener at localhost/35815] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:04:03,079 INFO [Listener at localhost/35815] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/java.io.tmpdir/Jetty_localhost_34521_hdfs____f0vhel/webapp 2023-02-13 16:04:03,171 INFO [Listener at localhost/35815] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34521 2023-02-13 16:04:03,175 WARN [Listener at localhost/35815] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:04:03,175 WARN [Listener at localhost/35815] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:04:03,224 WARN [Listener at localhost/36123] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:04:03,236 WARN [Listener at localhost/36123] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:04:03,239 WARN [Listener at localhost/36123] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:04:03,241 INFO [Listener at localhost/36123] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:04:03,247 INFO [Listener at localhost/36123] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/java.io.tmpdir/Jetty_localhost_45551_datanode____.m3rdt5/webapp 2023-02-13 16:04:03,342 INFO [Listener at localhost/36123] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45551 2023-02-13 16:04:03,352 WARN [Listener at localhost/40613] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:04:03,369 WARN [Listener at localhost/40613] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:04:03,370 WARN [Listener at localhost/40613] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:04:03,371 INFO [Listener at localhost/40613] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:04:03,378 INFO [Listener at localhost/40613] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/java.io.tmpdir/Jetty_localhost_36635_datanode____.uomsas/webapp 2023-02-13 16:04:03,465 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38fd5153a90fb265: Processing first storage report for DS-8ce642d8-28af-45bc-a0f1-44dc4fcec0a0 from datanode 51e3c73b-08a9-499b-b49e-6da54cd21fd5 2023-02-13 16:04:03,465 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38fd5153a90fb265: from storage DS-8ce642d8-28af-45bc-a0f1-44dc4fcec0a0 node DatanodeRegistration(127.0.0.1:34351, datanodeUuid=51e3c73b-08a9-499b-b49e-6da54cd21fd5, infoPort=44651, infoSecurePort=0, ipcPort=40613, storageInfo=lv=-57;cid=testClusterID;nsid=777372688;c=1676304242966), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:03,465 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x38fd5153a90fb265: Processing first storage report for DS-bb0d3bf9-a757-4736-8f44-e93a7b239b1f from datanode 51e3c73b-08a9-499b-b49e-6da54cd21fd5 2023-02-13 16:04:03,465 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x38fd5153a90fb265: from storage DS-bb0d3bf9-a757-4736-8f44-e93a7b239b1f node DatanodeRegistration(127.0.0.1:34351, datanodeUuid=51e3c73b-08a9-499b-b49e-6da54cd21fd5, infoPort=44651, infoSecurePort=0, ipcPort=40613, storageInfo=lv=-57;cid=testClusterID;nsid=777372688;c=1676304242966), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:03,475 INFO [Listener at localhost/40613] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36635 2023-02-13 16:04:03,484 WARN [Listener at localhost/33299] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:04:03,582 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4af780b04644aa0c: Processing first storage report for DS-8bb8a48a-5efe-42ab-92f3-83be9c0481a8 from datanode b9efda07-8d1a-47f5-9dff-e41e2b0b3745 2023-02-13 16:04:03,582 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4af780b04644aa0c: from storage DS-8bb8a48a-5efe-42ab-92f3-83be9c0481a8 node DatanodeRegistration(127.0.0.1:45211, datanodeUuid=b9efda07-8d1a-47f5-9dff-e41e2b0b3745, infoPort=33719, infoSecurePort=0, ipcPort=33299, storageInfo=lv=-57;cid=testClusterID;nsid=777372688;c=1676304242966), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:03,582 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4af780b04644aa0c: Processing first storage report for DS-a0a6456c-cc61-4aea-be30-b3175b6a8bcf from datanode b9efda07-8d1a-47f5-9dff-e41e2b0b3745 2023-02-13 16:04:03,582 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4af780b04644aa0c: from storage DS-a0a6456c-cc61-4aea-be30-b3175b6a8bcf node DatanodeRegistration(127.0.0.1:45211, datanodeUuid=b9efda07-8d1a-47f5-9dff-e41e2b0b3745, infoPort=33719, infoSecurePort=0, ipcPort=33299, storageInfo=lv=-57;cid=testClusterID;nsid=777372688;c=1676304242966), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:03,590 DEBUG [Listener at localhost/33299] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72 2023-02-13 16:04:03,592 INFO [Listener at localhost/33299] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/cluster_6bed958b-65c2-2ac9-acc3-76d137ef4961/zookeeper_0, clientPort=52886, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/cluster_6bed958b-65c2-2ac9-acc3-76d137ef4961/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/cluster_6bed958b-65c2-2ac9-acc3-76d137ef4961/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 16:04:03,593 INFO [Listener at localhost/33299] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52886 2023-02-13 16:04:03,593 INFO [Listener at localhost/33299] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,594 INFO [Listener at localhost/33299] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,607 INFO [Listener at localhost/33299] util.FSUtils(479): Created version file at hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5 with version=8 2023-02-13 16:04:03,607 INFO [Listener at localhost/33299] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,608 INFO [Listener at localhost/33299] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,609 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36123/user/jenkins/test-data/7099ab00-4125-f633-d814-85cbfe603ab9/hbase-staging 2023-02-13 16:04:03,610 INFO [Listener at localhost/33299] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:04:03,610 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:03,610 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:03,610 INFO [Listener at localhost/33299] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:04:03,611 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:03,611 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:04:03,611 INFO [Listener at localhost/33299] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:04:03,611 INFO [Listener at localhost/33299] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35303 2023-02-13 16:04:03,612 INFO [Listener at localhost/33299] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,612 INFO [Listener at localhost/33299] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,613 INFO [Listener at localhost/33299] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35303 connecting to ZooKeeper ensemble=127.0.0.1:52886 2023-02-13 16:04:03,622 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:353030x0, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:04:03,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35303-0x1004e6cc54c0000 connected 2023-02-13 16:04:03,641 DEBUG [Listener at localhost/33299] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:03,641 DEBUG [Listener at localhost/33299] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:03,641 DEBUG [Listener at localhost/33299] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:04:03,642 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35303 2023-02-13 16:04:03,644 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35303 2023-02-13 16:04:03,645 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35303 2023-02-13 16:04:03,648 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35303 2023-02-13 16:04:03,648 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35303 2023-02-13 16:04:03,648 INFO [Listener at localhost/33299] master.HMaster(439): hbase.rootdir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5, hbase.cluster.distributed=false 2023-02-13 16:04:03,661 INFO [Listener at localhost/33299] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:04:03,661 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:03,661 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:03,661 INFO [Listener at localhost/33299] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:04:03,661 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:03,661 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:04:03,662 INFO [Listener at localhost/33299] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:04:03,662 INFO [Listener at localhost/33299] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45937 2023-02-13 16:04:03,663 INFO [Listener at localhost/33299] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:04:03,666 DEBUG [Listener at localhost/33299] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:03,667 INFO [Listener at localhost/33299] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,667 INFO [Listener at localhost/33299] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,668 INFO [Listener at localhost/33299] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45937 connecting to ZooKeeper ensemble=127.0.0.1:52886 2023-02-13 16:04:03,673 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:459370x0, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:04:03,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:45937-0x1004e6cc54c0001 connected 2023-02-13 16:04:03,674 DEBUG [Listener at localhost/33299] zookeeper.ZKUtil(164): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:03,675 DEBUG [Listener at localhost/33299] zookeeper.ZKUtil(164): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:03,675 DEBUG [Listener at localhost/33299] zookeeper.ZKUtil(164): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:04:03,676 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45937 2023-02-13 16:04:03,676 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45937 2023-02-13 16:04:03,677 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45937 2023-02-13 16:04:03,679 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45937 2023-02-13 16:04:03,680 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45937 2023-02-13 16:04:03,690 INFO [Listener at localhost/33299] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:04:03,691 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:03,691 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:03,691 INFO [Listener at localhost/33299] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:04:03,691 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:03,691 INFO [Listener at localhost/33299] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:04:03,691 INFO [Listener at localhost/33299] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:04:03,692 INFO [Listener at localhost/33299] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44171 2023-02-13 16:04:03,692 INFO [Listener at localhost/33299] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:04:03,693 DEBUG [Listener at localhost/33299] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:03,693 INFO [Listener at localhost/33299] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,694 INFO [Listener at localhost/33299] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,695 INFO [Listener at localhost/33299] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44171 connecting to ZooKeeper ensemble=127.0.0.1:52886 2023-02-13 16:04:03,698 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:441710x0, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:04:03,699 DEBUG [Listener at localhost/33299] zookeeper.ZKUtil(164): regionserver:441710x0, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:03,700 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44171-0x1004e6cc54c0002 connected 2023-02-13 16:04:03,700 DEBUG [Listener at localhost/33299] zookeeper.ZKUtil(164): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:03,700 DEBUG [Listener at localhost/33299] zookeeper.ZKUtil(164): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:04:03,701 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44171 2023-02-13 16:04:03,701 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44171 2023-02-13 16:04:03,701 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44171 2023-02-13 16:04:03,704 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44171 2023-02-13 16:04:03,704 DEBUG [Listener at localhost/33299] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44171 2023-02-13 16:04:03,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35303,1676304243610 2023-02-13 16:04:03,710 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:04:03,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35303,1676304243610 2023-02-13 16:04:03,712 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:03,712 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:03,712 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:03,712 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:03,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:04:03,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35303,1676304243610 from backup master directory 2023-02-13 16:04:03,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:04:03,717 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35303,1676304243610 2023-02-13 16:04:03,717 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:04:03,717 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:04:03,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,35303,1676304243610 2023-02-13 16:04:03,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/hbase.id with ID: de1c1377-0e60-41e8-9ddf-7a21c3f5387f 2023-02-13 16:04:03,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:03,738 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:03,749 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x066724b9 to 127.0.0.1:52886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:03,753 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3827c148, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:03,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:03,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 16:04:03,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:03,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/data/master/store-tmp 2023-02-13 16:04:03,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:03,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:04:03,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:03,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:03,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:04:03,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:03,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:03,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304243763Disabling compacts and flushes for region at 1676304243763Disabling writes for close at 1676304243763Writing region close event to WAL at 1676304243763Closed at 1676304243763 2023-02-13 16:04:03,763 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/WALs/jenkins-hbase4.apache.org,35303,1676304243610 2023-02-13 16:04:03,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35303%2C1676304243610, suffix=, logDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/WALs/jenkins-hbase4.apache.org,35303,1676304243610, archiveDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/oldWALs, maxLogs=10 2023-02-13 16:04:03,778 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-8ce642d8-28af-45bc-a0f1-44dc4fcec0a0,DISK] 2023-02-13 16:04:03,778 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45211,DS-8bb8a48a-5efe-42ab-92f3-83be9c0481a8,DISK] 2023-02-13 16:04:03,779 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/WALs/jenkins-hbase4.apache.org,35303,1676304243610/jenkins-hbase4.apache.org%2C35303%2C1676304243610.1676304243765 2023-02-13 16:04:03,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-8ce642d8-28af-45bc-a0f1-44dc4fcec0a0,DISK], DatanodeInfoWithStorage[127.0.0.1:45211,DS-8bb8a48a-5efe-42ab-92f3-83be9c0481a8,DISK]] 2023-02-13 16:04:03,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:03,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:03,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:03,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:03,781 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:03,782 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 16:04:03,782 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 16:04:03,783 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:03,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:03,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:03,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:03,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:03,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74807260, jitterRate=0.11471503973007202}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:04:03,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676304243780Initializing all the Stores at 1676304243781 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304243781Cleaning up temporary data from old regions at 1676304243784 (+3 ms)Cleaning up detritus from prior splits at 1676304243784Region opened successfully at 1676304243789 (+5 ms) 2023-02-13 16:04:03,789 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 16:04:03,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 16:04:03,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 16:04:03,790 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 16:04:03,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 16:04:03,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 16:04:03,791 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 16:04:03,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 16:04:03,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 16:04:03,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 16:04:03,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 16:04:03,802 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 16:04:03,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 16:04:03,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 16:04:03,805 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:03,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 16:04:03,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 16:04:03,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 16:04:03,808 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:03,808 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:03,808 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:03,808 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:03,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,35303,1676304243610, sessionid=0x1004e6cc54c0000, setting cluster-up flag (Was=false) 2023-02-13 16:04:03,814 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:03,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 16:04:03,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35303,1676304243610 2023-02-13 16:04:03,821 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:03,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 16:04:03,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35303,1676304243610 2023-02-13 16:04:03,827 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.hbase-snapshot/.tmp 2023-02-13 16:04:03,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 16:04:03,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:03,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:03,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:03,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:03,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 16:04:03,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:04:03,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676304273833 2023-02-13 16:04:03,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 16:04:03,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 16:04:03,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 16:04:03,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 16:04:03,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 16:04:03,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 16:04:03,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,834 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:04:03,834 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 16:04:03,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 16:04:03,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 16:04:03,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 16:04:03,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 16:04:03,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 16:04:03,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304243835,5,FailOnTimeoutGroup] 2023-02-13 16:04:03,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304243835,5,FailOnTimeoutGroup] 2023-02-13 16:04:03,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,835 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:03,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 16:04:03,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,844 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:03,844 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:03,844 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5 2023-02-13 16:04:03,853 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:03,855 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:04:03,856 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/info 2023-02-13 16:04:03,856 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:04:03,856 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:03,856 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:04:03,857 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:04:03,858 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:04:03,858 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:03,858 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:04:03,859 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/table 2023-02-13 16:04:03,859 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:04:03,859 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:03,860 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740 2023-02-13 16:04:03,860 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740 2023-02-13 16:04:03,862 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:04:03,863 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:04:03,864 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:03,865 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69947526, jitterRate=0.042299360036849976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:04:03,865 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676304243854Initializing all the Stores at 1676304243854Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304243854Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304243854Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304243855 (+1 ms)Cleaning up temporary data from old regions at 1676304243861 (+6 ms)Cleaning up detritus from prior splits at 1676304243862 (+1 ms)Region opened successfully at 1676304243865 (+3 ms) 2023-02-13 16:04:03,865 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:04:03,865 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:04:03,865 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:04:03,865 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:04:03,865 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:04:03,865 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:03,865 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304243865Disabling compacts and flushes for region at 1676304243865Disabling writes for close at 1676304243865Writing region close event to WAL at 1676304243865Closed at 1676304243865 2023-02-13 16:04:03,866 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:04:03,866 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 16:04:03,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 16:04:03,868 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 16:04:03,869 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 16:04:03,910 INFO [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(952): ClusterId : de1c1377-0e60-41e8-9ddf-7a21c3f5387f 2023-02-13 16:04:03,910 INFO [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(952): ClusterId : de1c1377-0e60-41e8-9ddf-7a21c3f5387f 2023-02-13 16:04:03,910 DEBUG [RS:0;jenkins-hbase4:45937] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:04:03,910 DEBUG [RS:1;jenkins-hbase4:44171] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:04:03,912 DEBUG [RS:1;jenkins-hbase4:44171] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:04:03,912 DEBUG [RS:0;jenkins-hbase4:45937] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:04:03,912 DEBUG [RS:0;jenkins-hbase4:45937] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:04:03,912 DEBUG [RS:1;jenkins-hbase4:44171] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:04:03,915 DEBUG [RS:1;jenkins-hbase4:44171] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:04:03,915 DEBUG [RS:0;jenkins-hbase4:45937] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:04:03,917 DEBUG [RS:1;jenkins-hbase4:44171] zookeeper.ReadOnlyZKClient(139): Connect 0x50f85125 to 127.0.0.1:52886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:03,917 DEBUG [RS:0;jenkins-hbase4:45937] zookeeper.ReadOnlyZKClient(139): Connect 0x14b6df76 to 127.0.0.1:52886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:03,925 DEBUG [RS:0;jenkins-hbase4:45937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a713390, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:03,925 DEBUG [RS:1;jenkins-hbase4:44171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e3fb54a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:03,925 DEBUG [RS:0;jenkins-hbase4:45937] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e4eb406, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:04:03,925 DEBUG [RS:1;jenkins-hbase4:44171] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a003a55, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:04:03,934 DEBUG [RS:0;jenkins-hbase4:45937] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45937 2023-02-13 16:04:03,934 DEBUG [RS:1;jenkins-hbase4:44171] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44171 2023-02-13 16:04:03,934 INFO [RS:0;jenkins-hbase4:45937] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:04:03,934 INFO [RS:0;jenkins-hbase4:45937] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:04:03,934 INFO [RS:1;jenkins-hbase4:44171] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:04:03,934 DEBUG [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:04:03,934 INFO [RS:1;jenkins-hbase4:44171] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:04:03,934 DEBUG [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:04:03,935 INFO [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35303,1676304243610 with isa=jenkins-hbase4.apache.org/172.31.14.131:45937, startcode=1676304243660 2023-02-13 16:04:03,935 INFO [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35303,1676304243610 with isa=jenkins-hbase4.apache.org/172.31.14.131:44171, startcode=1676304243690 2023-02-13 16:04:03,935 DEBUG [RS:0;jenkins-hbase4:45937] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:04:03,935 DEBUG [RS:1;jenkins-hbase4:44171] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:04:03,937 INFO [RS-EventLoopGroup-15-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59575, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.8 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:04:03,937 INFO [RS-EventLoopGroup-15-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49527, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.9 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:04:03,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35303] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:03,938 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:03,939 DEBUG [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5 2023-02-13 16:04:03,939 DEBUG [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36123 2023-02-13 16:04:03,939 DEBUG [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5 2023-02-13 16:04:03,939 DEBUG [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:04:03,939 DEBUG [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:36123 2023-02-13 16:04:03,939 DEBUG [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:04:03,944 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:03,945 DEBUG [RS:0;jenkins-hbase4:45937] zookeeper.ZKUtil(162): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:03,945 DEBUG [RS:1;jenkins-hbase4:44171] zookeeper.ZKUtil(162): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:03,945 WARN [RS:0;jenkins-hbase4:45937] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:04:03,945 WARN [RS:1;jenkins-hbase4:44171] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:04:03,945 INFO [RS:0;jenkins-hbase4:45937] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:03,945 INFO [RS:1;jenkins-hbase4:44171] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:03,945 DEBUG [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/WALs/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:03,946 DEBUG [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1947): logDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/WALs/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:03,946 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44171,1676304243690] 2023-02-13 16:04:03,946 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45937,1676304243660] 2023-02-13 16:04:03,953 DEBUG [RS:1;jenkins-hbase4:44171] zookeeper.ZKUtil(162): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:03,953 DEBUG [RS:0;jenkins-hbase4:45937] zookeeper.ZKUtil(162): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:03,953 DEBUG [RS:1;jenkins-hbase4:44171] zookeeper.ZKUtil(162): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:03,953 DEBUG [RS:0;jenkins-hbase4:45937] zookeeper.ZKUtil(162): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:03,954 DEBUG [RS:1;jenkins-hbase4:44171] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:04:03,954 DEBUG [RS:0;jenkins-hbase4:45937] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:04:03,954 INFO [RS:1;jenkins-hbase4:44171] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:04:03,954 INFO [RS:0;jenkins-hbase4:45937] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:04:03,955 INFO [RS:1;jenkins-hbase4:44171] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:04:03,955 INFO [RS:1;jenkins-hbase4:44171] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:04:03,955 INFO [RS:1;jenkins-hbase4:44171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,956 INFO [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:04:03,956 INFO [RS:0;jenkins-hbase4:45937] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:04:03,957 INFO [RS:0;jenkins-hbase4:45937] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:04:03,957 INFO [RS:0;jenkins-hbase4:45937] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,957 INFO [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:04:03,957 INFO [RS:1;jenkins-hbase4:44171] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,958 DEBUG [RS:1;jenkins-hbase4:44171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,958 DEBUG [RS:1;jenkins-hbase4:44171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,958 DEBUG [RS:1;jenkins-hbase4:44171] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,958 DEBUG [RS:1;jenkins-hbase4:44171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,958 DEBUG [RS:1;jenkins-hbase4:44171] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,958 DEBUG [RS:1;jenkins-hbase4:44171] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:04:03,958 DEBUG [RS:1;jenkins-hbase4:44171] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,958 DEBUG [RS:1;jenkins-hbase4:44171] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,958 DEBUG [RS:1;jenkins-hbase4:44171] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,958 DEBUG [RS:1;jenkins-hbase4:44171] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,958 INFO [RS:0;jenkins-hbase4:45937] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,962 DEBUG [RS:0;jenkins-hbase4:45937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,962 DEBUG [RS:0;jenkins-hbase4:45937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,962 DEBUG [RS:0;jenkins-hbase4:45937] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,962 DEBUG [RS:0;jenkins-hbase4:45937] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,962 DEBUG [RS:0;jenkins-hbase4:45937] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,962 DEBUG [RS:0;jenkins-hbase4:45937] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:04:03,962 DEBUG [RS:0;jenkins-hbase4:45937] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,962 DEBUG [RS:0;jenkins-hbase4:45937] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,962 DEBUG [RS:0;jenkins-hbase4:45937] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,962 DEBUG [RS:0;jenkins-hbase4:45937] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:03,964 INFO [RS:1;jenkins-hbase4:44171] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,964 INFO [RS:1;jenkins-hbase4:44171] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,964 INFO [RS:1;jenkins-hbase4:44171] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,964 INFO [RS:0;jenkins-hbase4:45937] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,964 INFO [RS:0;jenkins-hbase4:45937] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,965 INFO [RS:0;jenkins-hbase4:45937] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,975 INFO [RS:1;jenkins-hbase4:44171] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:04:03,975 INFO [RS:1;jenkins-hbase4:44171] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44171,1676304243690-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,978 INFO [RS:0;jenkins-hbase4:45937] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:04:03,978 INFO [RS:0;jenkins-hbase4:45937] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45937,1676304243660-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:03,985 INFO [RS:1;jenkins-hbase4:44171] regionserver.Replication(203): jenkins-hbase4.apache.org,44171,1676304243690 started 2023-02-13 16:04:03,985 INFO [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44171,1676304243690, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44171, sessionid=0x1004e6cc54c0002 2023-02-13 16:04:03,986 DEBUG [RS:1;jenkins-hbase4:44171] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:04:03,986 DEBUG [RS:1;jenkins-hbase4:44171] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:03,986 DEBUG [RS:1;jenkins-hbase4:44171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44171,1676304243690' 2023-02-13 16:04:03,986 DEBUG [RS:1;jenkins-hbase4:44171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:03,986 DEBUG [RS:1;jenkins-hbase4:44171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:03,986 DEBUG [RS:1;jenkins-hbase4:44171] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:04:03,986 DEBUG [RS:1;jenkins-hbase4:44171] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:04:03,986 DEBUG [RS:1;jenkins-hbase4:44171] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:03,986 DEBUG [RS:1;jenkins-hbase4:44171] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44171,1676304243690' 2023-02-13 16:04:03,986 DEBUG [RS:1;jenkins-hbase4:44171] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:03,987 DEBUG [RS:1;jenkins-hbase4:44171] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:03,987 DEBUG [RS:1;jenkins-hbase4:44171] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:04:03,987 INFO [RS:1;jenkins-hbase4:44171] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:04:03,987 INFO [RS:1;jenkins-hbase4:44171] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:04:03,989 INFO [RS:0;jenkins-hbase4:45937] regionserver.Replication(203): jenkins-hbase4.apache.org,45937,1676304243660 started 2023-02-13 16:04:03,989 INFO [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,45937,1676304243660, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45937, sessionid=0x1004e6cc54c0001 2023-02-13 16:04:03,989 DEBUG [RS:0;jenkins-hbase4:45937] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:04:03,989 DEBUG [RS:0;jenkins-hbase4:45937] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:03,989 DEBUG [RS:0;jenkins-hbase4:45937] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45937,1676304243660' 2023-02-13 16:04:03,989 DEBUG [RS:0;jenkins-hbase4:45937] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:03,990 DEBUG [RS:0;jenkins-hbase4:45937] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:03,990 DEBUG [RS:0;jenkins-hbase4:45937] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:04:03,990 DEBUG [RS:0;jenkins-hbase4:45937] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:04:03,990 DEBUG [RS:0;jenkins-hbase4:45937] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:03,990 DEBUG [RS:0;jenkins-hbase4:45937] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45937,1676304243660' 2023-02-13 16:04:03,990 DEBUG [RS:0;jenkins-hbase4:45937] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:03,990 DEBUG [RS:0;jenkins-hbase4:45937] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:03,990 DEBUG [RS:0;jenkins-hbase4:45937] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:04:03,990 INFO [RS:0;jenkins-hbase4:45937] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:04:03,990 INFO [RS:0;jenkins-hbase4:45937] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:04:04,019 DEBUG [jenkins-hbase4:35303] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 16:04:04,019 DEBUG [jenkins-hbase4:35303] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:04:04,021 DEBUG [jenkins-hbase4:35303] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:04:04,021 DEBUG [jenkins-hbase4:35303] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:04:04,021 DEBUG [jenkins-hbase4:35303] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:04:04,021 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45937,1676304243660, state=OPENING 2023-02-13 16:04:04,023 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 16:04:04,024 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:04,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45937,1676304243660}] 2023-02-13 16:04:04,027 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:04:04,181 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:04,181 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:04:04,183 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53102, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:04:04,186 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 16:04:04,186 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:04,187 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45937%2C1676304243660.meta, suffix=.meta, logDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/WALs/jenkins-hbase4.apache.org,45937,1676304243660, archiveDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/oldWALs, maxLogs=32 2023-02-13 16:04:04,201 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45211,DS-8bb8a48a-5efe-42ab-92f3-83be9c0481a8,DISK] 2023-02-13 16:04:04,202 DEBUG [RS-EventLoopGroup-17-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-8ce642d8-28af-45bc-a0f1-44dc4fcec0a0,DISK] 2023-02-13 16:04:04,203 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/WALs/jenkins-hbase4.apache.org,45937,1676304243660/jenkins-hbase4.apache.org%2C45937%2C1676304243660.meta.1676304244188.meta 2023-02-13 16:04:04,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45211,DS-8bb8a48a-5efe-42ab-92f3-83be9c0481a8,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-8ce642d8-28af-45bc-a0f1-44dc4fcec0a0,DISK]] 2023-02-13 16:04:04,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:04,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 16:04:04,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 16:04:04,204 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 16:04:04,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 16:04:04,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:04,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 16:04:04,204 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 16:04:04,206 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:04:04,207 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/info 2023-02-13 16:04:04,207 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/info 2023-02-13 16:04:04,207 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:04:04,207 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:04,208 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:04:04,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:04:04,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:04:04,209 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:04:04,209 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:04,209 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:04:04,210 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/table 2023-02-13 16:04:04,210 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/table 2023-02-13 16:04:04,210 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:04:04,211 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:04,211 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740 2023-02-13 16:04:04,212 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740 2023-02-13 16:04:04,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:04:04,214 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:04:04,215 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74919514, jitterRate=0.1163877546787262}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:04:04,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676304244205Writing region info on filesystem at 1676304244205Initializing all the Stores at 1676304244205Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304244205Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304244205Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304244206 (+1 ms)Cleaning up temporary data from old regions at 1676304244213 (+7 ms)Cleaning up detritus from prior splits at 1676304244213Running coprocessor post-open hooks at 1676304244215 (+2 ms)Region opened successfully at 1676304244215 2023-02-13 16:04:04,216 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676304244181 2023-02-13 16:04:04,219 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 16:04:04,220 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 16:04:04,220 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45937,1676304243660, state=OPEN 2023-02-13 16:04:04,221 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 16:04:04,221 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:04:04,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 16:04:04,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45937,1676304243660 in 197 msec 2023-02-13 16:04:04,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 16:04:04,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 357 msec 2023-02-13 16:04:04,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-02-13 16:04:04,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676304243710, completionTime=-1 2023-02-13 16:04:04,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 16:04:04,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 16:04:04,230 DEBUG [hconnection-0x76414-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:04,232 INFO [RS-EventLoopGroup-16-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53110, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:04,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 16:04:04,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676304304233 2023-02-13 16:04:04,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676304364233 2023-02-13 16:04:04,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 6 msec 2023-02-13 16:04:04,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35303,1676304243610-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:04,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35303,1676304243610-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:04,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35303,1676304243610-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:04,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35303, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:04,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:04,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 16:04:04,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:04,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 16:04:04,243 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 16:04:04,243 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:04:04,243 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:04:04,245 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:04,245 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895 empty. 2023-02-13 16:04:04,245 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:04,245 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 16:04:04,253 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:04,254 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 811e1f412e46585a01fcb83b6989e895, NAME => 'hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp 2023-02-13 16:04:04,261 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:04,262 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 811e1f412e46585a01fcb83b6989e895, disabling compactions & flushes 2023-02-13 16:04:04,262 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:04,262 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:04,262 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. after waiting 0 ms 2023-02-13 16:04:04,262 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:04,262 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:04,262 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 811e1f412e46585a01fcb83b6989e895: Waiting for close lock at 1676304244262Disabling compacts and flushes for region at 1676304244262Disabling writes for close at 1676304244262Writing region close event to WAL at 1676304244262Closed at 1676304244262 2023-02-13 16:04:04,263 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:04:04,264 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304244264"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304244264"}]},"ts":"1676304244264"} 2023-02-13 16:04:04,266 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:04:04,267 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:04:04,267 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304244267"}]},"ts":"1676304244267"} 2023-02-13 16:04:04,268 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 16:04:04,272 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:04:04,272 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:04:04,273 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:04:04,273 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:04:04,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=811e1f412e46585a01fcb83b6989e895, ASSIGN}] 2023-02-13 16:04:04,275 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=811e1f412e46585a01fcb83b6989e895, ASSIGN 2023-02-13 16:04:04,275 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=811e1f412e46585a01fcb83b6989e895, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44171,1676304243690; forceNewPlan=false, retain=false 2023-02-13 16:04:04,425 INFO [jenkins-hbase4:35303] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:04:04,426 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=811e1f412e46585a01fcb83b6989e895, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:04,426 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304244426"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304244426"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304244426"}]},"ts":"1676304244426"} 2023-02-13 16:04:04,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 811e1f412e46585a01fcb83b6989e895, server=jenkins-hbase4.apache.org,44171,1676304243690}] 2023-02-13 16:04:04,580 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:04,580 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:04:04,581 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36756, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:04:04,584 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:04,586 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44171%2C1676304243690, suffix=, logDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/WALs/jenkins-hbase4.apache.org,44171,1676304243690, archiveDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/oldWALs, maxLogs=32 2023-02-13 16:04:04,599 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-8ce642d8-28af-45bc-a0f1-44dc4fcec0a0,DISK] 2023-02-13 16:04:04,599 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45211,DS-8bb8a48a-5efe-42ab-92f3-83be9c0481a8,DISK] 2023-02-13 16:04:04,601 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/WALs/jenkins-hbase4.apache.org,44171,1676304243690/jenkins-hbase4.apache.org%2C44171%2C1676304243690.1676304244586 2023-02-13 16:04:04,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34351,DS-8ce642d8-28af-45bc-a0f1-44dc4fcec0a0,DISK], DatanodeInfoWithStorage[127.0.0.1:45211,DS-8bb8a48a-5efe-42ab-92f3-83be9c0481a8,DISK]] 2023-02-13 16:04:04,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 811e1f412e46585a01fcb83b6989e895, NAME => 'hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:04,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:04,601 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:04,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:04,602 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:04,603 INFO [StoreOpener-811e1f412e46585a01fcb83b6989e895-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:04,604 DEBUG [StoreOpener-811e1f412e46585a01fcb83b6989e895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895/info 2023-02-13 16:04:04,604 DEBUG [StoreOpener-811e1f412e46585a01fcb83b6989e895-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895/info 2023-02-13 16:04:04,604 INFO [StoreOpener-811e1f412e46585a01fcb83b6989e895-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 811e1f412e46585a01fcb83b6989e895 columnFamilyName info 2023-02-13 16:04:04,604 INFO [StoreOpener-811e1f412e46585a01fcb83b6989e895-1] regionserver.HStore(310): Store=811e1f412e46585a01fcb83b6989e895/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:04,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:04,605 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:04,607 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:04,609 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:04,609 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 811e1f412e46585a01fcb83b6989e895; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72612270, jitterRate=0.08200713992118835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:04:04,609 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 811e1f412e46585a01fcb83b6989e895: Running coprocessor pre-open hook at 1676304244602Writing region info on filesystem at 1676304244602Initializing all the Stores at 1676304244602Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304244602Cleaning up temporary data from old regions at 1676304244606 (+4 ms)Cleaning up detritus from prior splits at 1676304244606Running coprocessor post-open hooks at 1676304244609 (+3 ms)Region opened successfully at 1676304244609 2023-02-13 16:04:04,610 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895., pid=6, masterSystemTime=1676304244580 2023-02-13 16:04:04,613 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:04,614 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:04,614 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=811e1f412e46585a01fcb83b6989e895, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:04,614 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304244614"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304244614"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304244614"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304244614"}]},"ts":"1676304244614"} 2023-02-13 16:04:04,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 16:04:04,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 811e1f412e46585a01fcb83b6989e895, server=jenkins-hbase4.apache.org,44171,1676304243690 in 187 msec 2023-02-13 16:04:04,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 16:04:04,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=811e1f412e46585a01fcb83b6989e895, ASSIGN in 343 msec 2023-02-13 16:04:04,618 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:04:04,618 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304244618"}]},"ts":"1676304244618"} 2023-02-13 16:04:04,619 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 16:04:04,622 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:04:04,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 381 msec 2023-02-13 16:04:04,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 16:04:04,644 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:04:04,644 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:04,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:04,647 INFO [RS-EventLoopGroup-17-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36760, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:04,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 16:04:04,661 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:04:04,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 14 msec 2023-02-13 16:04:04,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 16:04:04,677 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:04:04,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 8 msec 2023-02-13 16:04:04,684 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 16:04:04,687 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 16:04:04,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.970sec 2023-02-13 16:04:04,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 16:04:04,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 16:04:04,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 16:04:04,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35303,1676304243610-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 16:04:04,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35303,1676304243610-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 16:04:04,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 16:04:04,710 DEBUG [Listener at localhost/33299] zookeeper.ReadOnlyZKClient(139): Connect 0x6694bb79 to 127.0.0.1:52886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:04,719 DEBUG [Listener at localhost/33299] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56f8d7dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:04,720 DEBUG [hconnection-0x5b1fe3e5-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:04,722 INFO [RS-EventLoopGroup-16-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53118, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:04,724 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35303,1676304243610 2023-02-13 16:04:04,724 DEBUG [Listener at localhost/33299] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 16:04:04,728 DEBUG [Listener at localhost/33299] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 16:04:04,729 INFO [RS-EventLoopGroup-15-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42704, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 16:04:04,730 INFO [Listener at localhost/33299] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-13 16:04:04,730 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-13 16:04:04,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 16:04:04,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 94 connection: 172.31.14.131:42704 deadline: 1676304304730, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMockedMapReduceSingleRegion 2023-02-13 16:04:04,731 INFO [Listener at localhost/33299] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMockedMapReduceSingleRegion' 2023-02-13 16:04:04,733 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:04,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:04,734 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:04:04,735 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMockedMapReduceSingleRegion" procId is: 10 2023-02-13 16:04:04,735 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:04:04,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:04,736 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:04,737 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531 empty. 2023-02-13 16:04:04,737 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:04,737 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-13 16:04:04,744 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:04,745 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(7671): creating {ENCODED => d0ac20f8d2efe567a6ec0082cee49531, NAME => 'testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp 2023-02-13 16:04:04,750 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:04,751 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1603): Closing d0ac20f8d2efe567a6ec0082cee49531, disabling compactions & flushes 2023-02-13 16:04:04,751 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:04,751 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:04,751 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. after waiting 0 ms 2023-02-13 16:04:04,751 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:04,751 INFO [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:04,751 DEBUG [RegionOpenAndInit-testWithMockedMapReduceSingleRegion-pool-0] regionserver.HRegion(1557): Region close journal for d0ac20f8d2efe567a6ec0082cee49531: Waiting for close lock at 1676304244751Disabling compacts and flushes for region at 1676304244751Disabling writes for close at 1676304244751Writing region close event to WAL at 1676304244751Closed at 1676304244751 2023-02-13 16:04:04,753 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:04:04,753 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676304244753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304244753"}]},"ts":"1676304244753"} 2023-02-13 16:04:04,755 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:04:04,755 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:04:04,755 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304244755"}]},"ts":"1676304244755"} 2023-02-13 16:04:04,756 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLING in hbase:meta 2023-02-13 16:04:04,760 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:04:04,761 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:04:04,761 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:04:04,761 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:04:04,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d0ac20f8d2efe567a6ec0082cee49531, ASSIGN}] 2023-02-13 16:04:04,763 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d0ac20f8d2efe567a6ec0082cee49531, ASSIGN 2023-02-13 16:04:04,764 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d0ac20f8d2efe567a6ec0082cee49531, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45937,1676304243660; forceNewPlan=false, retain=false 2023-02-13 16:04:04,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:04,914 INFO [jenkins-hbase4:35303] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:04:04,914 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d0ac20f8d2efe567a6ec0082cee49531, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:04,914 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676304244914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304244914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304244914"}]},"ts":"1676304244914"} 2023-02-13 16:04:04,916 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure d0ac20f8d2efe567a6ec0082cee49531, server=jenkins-hbase4.apache.org,45937,1676304243660}] 2023-02-13 16:04:04,992 INFO [RS:0;jenkins-hbase4:45937] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45937%2C1676304243660, suffix=, logDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/WALs/jenkins-hbase4.apache.org,45937,1676304243660, archiveDir=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/oldWALs, maxLogs=32 2023-02-13 16:04:05,004 DEBUG [RS-EventLoopGroup-17-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45211,DS-8bb8a48a-5efe-42ab-92f3-83be9c0481a8,DISK] 2023-02-13 16:04:05,005 DEBUG [RS-EventLoopGroup-17-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34351,DS-8ce642d8-28af-45bc-a0f1-44dc4fcec0a0,DISK] 2023-02-13 16:04:05,006 INFO [RS:0;jenkins-hbase4:45937] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/WALs/jenkins-hbase4.apache.org,45937,1676304243660/jenkins-hbase4.apache.org%2C45937%2C1676304243660.1676304244992 2023-02-13 16:04:05,006 DEBUG [RS:0;jenkins-hbase4:45937] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45211,DS-8bb8a48a-5efe-42ab-92f3-83be9c0481a8,DISK], DatanodeInfoWithStorage[127.0.0.1:34351,DS-8ce642d8-28af-45bc-a0f1-44dc4fcec0a0,DISK]] 2023-02-13 16:04:05,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:05,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:05,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d0ac20f8d2efe567a6ec0082cee49531, NAME => 'testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:05,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMockedMapReduceSingleRegion d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:05,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:05,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:05,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:05,072 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:05,074 DEBUG [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1 2023-02-13 16:04:05,074 DEBUG [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1 2023-02-13 16:04:05,074 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0ac20f8d2efe567a6ec0082cee49531 columnFamilyName f1 2023-02-13 16:04:05,074 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] regionserver.HStore(310): Store=d0ac20f8d2efe567a6ec0082cee49531/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:05,074 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:05,075 DEBUG [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2 2023-02-13 16:04:05,075 DEBUG [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2 2023-02-13 16:04:05,076 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0ac20f8d2efe567a6ec0082cee49531 columnFamilyName f2 2023-02-13 16:04:05,076 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] regionserver.HStore(310): Store=d0ac20f8d2efe567a6ec0082cee49531/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:05,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:05,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:05,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:05,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:05,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:05,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened d0ac20f8d2efe567a6ec0082cee49531; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67360509, jitterRate=0.0037498027086257935}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:05,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for d0ac20f8d2efe567a6ec0082cee49531: Running coprocessor pre-open hook at 1676304245071Writing region info on filesystem at 1676304245071Initializing all the Stores at 1676304245072 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304245072Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304245072Cleaning up temporary data from old regions at 1676304245077 (+5 ms)Cleaning up detritus from prior splits at 1676304245077Running coprocessor post-open hooks at 1676304245081 (+4 ms)Region opened successfully at 1676304245081 2023-02-13 16:04:05,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531., pid=12, masterSystemTime=1676304245068 2023-02-13 16:04:05,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:05,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:05,084 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=d0ac20f8d2efe567a6ec0082cee49531, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,084 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676304245084"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304245084"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304245084"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304245084"}]},"ts":"1676304245084"} 2023-02-13 16:04:05,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 16:04:05,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure d0ac20f8d2efe567a6ec0082cee49531, server=jenkins-hbase4.apache.org,45937,1676304243660 in 169 msec 2023-02-13 16:04:05,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 16:04:05,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d0ac20f8d2efe567a6ec0082cee49531, ASSIGN in 326 msec 2023-02-13 16:04:05,089 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:04:05,089 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304245089"}]},"ts":"1676304245089"} 2023-02-13 16:04:05,090 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=ENABLED in hbase:meta 2023-02-13 16:04:05,092 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMockedMapReduceSingleRegion execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:04:05,093 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMockedMapReduceSingleRegion in 359 msec 2023-02-13 16:04:05,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:05,340 INFO [Listener at localhost/33299] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 10 completed 2023-02-13 16:04:05,340 DEBUG [Listener at localhost/33299] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMockedMapReduceSingleRegion get assigned. Timeout = 60000ms 2023-02-13 16:04:05,340 INFO [Listener at localhost/33299] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:04:05,344 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(3484): All regions for table testWithMockedMapReduceSingleRegion assigned to meta. Checking AM states. 2023-02-13 16:04:05,344 INFO [Listener at localhost/33299] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:04:05,344 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(3504): All regions for table testWithMockedMapReduceSingleRegion assigned. 2023-02-13 16:04:05,344 INFO [Listener at localhost/33299] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 16:04:05,390 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45937] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:05,472 INFO [Listener at localhost/33299] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 16:04:05,472 INFO [Listener at localhost/33299] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 16:04:05,473 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 16:04:05,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676304245473 (current time:1676304245473). 2023-02-13 16:04:05,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 16:04:05,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] zookeeper.ReadOnlyZKClient(139): Connect 0x2d041471 to 127.0.0.1:52886 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:05,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@714e2f2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:05,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:05,479 INFO [RS-EventLoopGroup-16-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53128, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:05,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d041471 to 127.0.0.1:52886 2023-02-13 16:04:05,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:05,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 16:04:05,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 16:04:05,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 16:04:05,484 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 16:04:05,484 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE; timeout=600000, timestamp=1676304845484 2023-02-13 16:04:05,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } 2023-02-13 16:04:05,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,485 DEBUG [Listener at localhost/33299] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 16:04:05,485 DEBUG [Listener at localhost/33299] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 16:04:05,486 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE 2023-02-13 16:04:05,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 16:04:05,487 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=EXCLUSIVE in 4 msec 2023-02-13 16:04:05,488 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 16:04:05,488 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED; timeout=600000, timestamp=1676304845488 2023-02-13 16:04:05,495 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,495 INFO [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-13 16:04:05,495 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:04:05,496 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-13 16:04:05,496 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 16:04:05,496 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,496 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,499 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:05,499 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,499 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:05,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:05,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:05,499 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,499 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:04:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-13 16:04:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 91 2023-02-13 16:04:05,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-13 16:04:05,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMockedMapReduceSingleRegion from table testWithMockedMapReduceSingleRegion type FLUSH 2023-02-13 16:04:05,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,500 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,500 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-13 16:04:05,500 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:04:05,501 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 300000ms 2023-02-13 16:04:05,501 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:04:05,501 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 16:04:05,501 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 16:04:05,502 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 16:04:05,502 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 16:04:05,502 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45937,1676304243660' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 16:04:05,502 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44171,1676304243690' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 16:04:05,503 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,503 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:05,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:04:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,504 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:05,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:05,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:05,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45937,1676304243660' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-13 16:04:05,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bb2324d[Count = 0] remaining members to acquire global barrier 2023-02-13 16:04:05,506 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 16:04:05,506 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,507 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,507 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 16:04:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 16:04:05,507 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,507 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:04:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 16:04:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44171,1676304243690' in zk 2023-02-13 16:04:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 16:04:05,507 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 16:04:05,507 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:05,507 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. started... 2023-02-13 16:04:05,507 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] regionserver.HRegion(2744): Flushing d0ac20f8d2efe567a6ec0082cee49531 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 16:04:05,509 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 16:04:05,509 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:05,509 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 16:04:05,528 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/.tmp/f1/853f726cfa0d47e380d339e27f9452a9 2023-02-13 16:04:05,544 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/.tmp/f2/9e86c21565a240f6b9183afdcf2bd41a 2023-02-13 16:04:05,549 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/.tmp/f1/853f726cfa0d47e380d339e27f9452a9 as hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/853f726cfa0d47e380d339e27f9452a9 2023-02-13 16:04:05,553 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/853f726cfa0d47e380d339e27f9452a9, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 16:04:05,553 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/.tmp/f2/9e86c21565a240f6b9183afdcf2bd41a as hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/9e86c21565a240f6b9183afdcf2bd41a 2023-02-13 16:04:05,557 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/9e86c21565a240f6b9183afdcf2bd41a, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 16:04:05,558 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for d0ac20f8d2efe567a6ec0082cee49531 in 50ms, sequenceid=5, compaction requested=false 2023-02-13 16:04:05,558 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testWithMockedMapReduceSingleRegion' 2023-02-13 16:04:05,558 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d0ac20f8d2efe567a6ec0082cee49531: 2023-02-13 16:04:05,558 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.' region-info for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,558 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:04:05,558 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/853f726cfa0d47e380d339e27f9452a9] hfiles 2023-02-13 16:04:05,558 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/853f726cfa0d47e380d339e27f9452a9 for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,558 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/9e86c21565a240f6b9183afdcf2bd41a] hfiles 2023-02-13 16:04:05,558 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/9e86c21565a240f6b9183afdcf2bd41a for snapshot=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,567 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. completed. 2023-02-13 16:04:05,567 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:05,567 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 16:04:05,567 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 16:04:05,567 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,567 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 16:04:05,567 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,45937,1676304243660' in zk 2023-02-13 16:04:05,569 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 16:04:05,569 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,569 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:05,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:05,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:04:05,569 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 16:04:05,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:05,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:05,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:05,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,45937,1676304243660': 2023-02-13 16:04:05,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45937,1676304243660' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 16:04:05,572 INFO [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-13 16:04:05,572 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:04:05,572 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:04:05,572 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,572 INFO [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 16:04:05,574 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,574 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,574 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,574 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:05,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:04:05,574 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:05,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:05,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:05,575 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,575 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,577 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:05,577 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,583 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,583 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:05,583 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:05,583 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:05,584 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:05,584 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:05,584 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:05,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,584 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:05,583 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:05,584 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,584 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,584 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,584 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,584 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,584 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:05,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:05,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:05,586 DEBUG [Listener at localhost/33299] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:04:05,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-13 16:04:05,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:04:05,588 DEBUG [Listener at localhost/33299] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 16:04:05,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion to hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.hbase-snapshot/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,629 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed 2023-02-13 16:04:05,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,629 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.hbase-snapshot/.tmp/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMockedMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMockedMapReduceSingleRegion at 1676304245484Consolidate snapshot: testWithMockedMapReduceSingleRegion at 1676304245584 (+100 ms)Loading Region manifests for testWithMockedMapReduceSingleRegion at 1676304245584Writing data manifest for testWithMockedMapReduceSingleRegion at 1676304245587 (+3 ms)Verifying snapshot: testWithMockedMapReduceSingleRegion at 1676304245593 (+6 ms)Snapshot testWithMockedMapReduceSingleRegion of table testWithMockedMapReduceSingleRegion completed at 1676304245629 (+36 ms) 2023-02-13 16:04:05,632 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED 2023-02-13 16:04:05,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMockedMapReduceSingleRegion, type=SHARED in 147 msec 2023-02-13 16:04:05,788 DEBUG [Listener at localhost/33299] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:04:05,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 } is done 2023-02-13 16:04:05,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMockedMapReduceSingleRegion table=testWithMockedMapReduceSingleRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 16:04:05,790 INFO [Listener at localhost/33299] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 16:04:05,793 INFO [Listener at localhost/33299] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 16:04:05,797 INFO [Listener at localhost/33299] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 16:04:05,824 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45937] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:05,903 INFO [Listener at localhost/33299] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 16:04:05,908 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 16:04:05,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] procedure.ProcedureCoordinator(165): Submitting procedure testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,910 INFO [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMockedMapReduceSingleRegion' 2023-02-13 16:04:05,910 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:04:05,911 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' 2023-02-13 16:04:05,911 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMockedMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 16:04:05,912 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,912 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,913 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:05,913 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:05,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:05,913 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:05,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:05,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:05,913 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,913 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:04:05,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:04:05,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:04:05,914 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,914 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,914 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-13 16:04:05,914 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:04:05,915 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMockedMapReduceSingleRegion' with timeout 60000ms 2023-02-13 16:04:05,915 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 16:04:05,915 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:04:05,916 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMockedMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 16:04:05,916 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 16:04:05,916 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:05,916 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. started... 2023-02-13 16:04:05,916 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 16:04:05,916 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 16:04:05,916 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44171,1676304243690' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 16:04:05,916 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d0ac20f8d2efe567a6ec0082cee49531 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 16:04:05,917 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,918 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,918 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:05,930 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/.tmp/f1/6b1195937e2c4f2e8efb49cd5de67787 2023-02-13 16:04:05,946 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/.tmp/f2/1f5fe409123240e39112bca483b9d696 2023-02-13 16:04:05,950 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/.tmp/f1/6b1195937e2c4f2e8efb49cd5de67787 as hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/6b1195937e2c4f2e8efb49cd5de67787 2023-02-13 16:04:05,954 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/6b1195937e2c4f2e8efb49cd5de67787, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 16:04:05,954 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/.tmp/f2/1f5fe409123240e39112bca483b9d696 as hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/1f5fe409123240e39112bca483b9d696 2023-02-13 16:04:05,958 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/1f5fe409123240e39112bca483b9d696, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 16:04:05,958 INFO [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for d0ac20f8d2efe567a6ec0082cee49531 in 42ms, sequenceid=9, compaction requested=false 2023-02-13 16:04:05,959 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d0ac20f8d2efe567a6ec0082cee49531: 2023-02-13 16:04:05,959 DEBUG [rs(jenkins-hbase4.apache.org,45937,1676304243660)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:05,959 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 16:04:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 16:04:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMockedMapReduceSingleRegion' locally acquired 2023-02-13 16:04:05,960 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45937,1676304243660' joining acquired barrier for procedure (testWithMockedMapReduceSingleRegion) in zk 2023-02-13 16:04:05,961 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,961 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:05,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:05,961 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,961 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMockedMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:05,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:05,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:05,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:05,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45937,1676304243660' joining acquired barrier for procedure 'testWithMockedMapReduceSingleRegion' on coordinator 2023-02-13 16:04:05,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f8da5e3[Count = 0] remaining members to acquire global barrier 2023-02-13 16:04:05,963 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMockedMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 16:04:05,963 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,965 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,965 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,965 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 16:04:05,965 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 16:04:05,965 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,44171,1676304243690' in zk 2023-02-13 16:04:05,965 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,965 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:04:05,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,965 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMockedMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 16:04:05,965 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMockedMapReduceSingleRegion' locally completed 2023-02-13 16:04:05,965 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMockedMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,45937,1676304243660' in zk 2023-02-13 16:04:05,966 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 16:04:05,966 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:05,966 DEBUG [member: 'jenkins-hbase4.apache.org,44171,1676304243690' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 16:04:05,967 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,967 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMockedMapReduceSingleRegion' has notified controller of completion 2023-02-13 16:04:05,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:05,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:05,967 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:05,967 DEBUG [member: 'jenkins-hbase4.apache.org,45937,1676304243660' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMockedMapReduceSingleRegion' completed. 2023-02-13 16:04:05,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:05,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:05,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:05,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMockedMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,45937,1676304243660': 2023-02-13 16:04:05,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45937,1676304243660' released barrier for procedure'testWithMockedMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 16:04:05,969 INFO [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMockedMapReduceSingleRegion' execution completed 2023-02-13 16:04:05,970 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:04:05,970 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:04:05,970 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,970 INFO [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMockedMapReduceSingleRegionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 16:04:05,971 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,971 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,971 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:05,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:05,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:05,971 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,971 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:05,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:05,972 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:05,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:05,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:05,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:05,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,972 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:05,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,973 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:05,974 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,977 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,977 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:05,977 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,977 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:05,977 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:05,977 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,977 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:05,978 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMockedMapReduceSingleRegion' 2023-02-13 16:04:05,978 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 16:04:05,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:05,978 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:05,978 DEBUG [Listener at localhost/33299] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMockedMapReduceSingleRegion'' to complete. (max 20000 ms per retry) 2023-02-13 16:04:05,978 DEBUG [(jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:05,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:05,978 DEBUG [Listener at localhost/33299] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 16:04:05,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:05,978 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:05,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:05,978 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:05,978 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:05,978 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,978 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:05,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:05,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:06,078 DEBUG [Listener at localhost/33299] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 16:04:06,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 16:04:06,084 INFO [Listener at localhost/33299] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676304245473 type: FLUSH version: 2 ttl: 0 2023-02-13 16:04:06,084 DEBUG [Listener at localhost/33299] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:36123/user/jenkins/test-data/7099ab00-4125-f633-d814-85cbfe603ab9/testWithMockedMapReduceSingleRegion/9e4a8627-19a9-45c7-b168-e002679d318d/data/default/testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,084 INFO [Listener at localhost/33299] snapshot.RestoreSnapshotHelper(239): region to add: d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:06,084 INFO [Listener at localhost/33299] snapshot.RestoreSnapshotHelper(585): clone region=d0ac20f8d2efe567a6ec0082cee49531 as d0ac20f8d2efe567a6ec0082cee49531 in snapshot testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,085 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => d0ac20f8d2efe567a6ec0082cee49531, NAME => 'testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMockedMapReduceSingleRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36123/user/jenkins/test-data/7099ab00-4125-f633-d814-85cbfe603ab9/testWithMockedMapReduceSingleRegion/9e4a8627-19a9-45c7-b168-e002679d318d 2023-02-13 16:04:06,091 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:06,091 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 853f726cfa0d47e380d339e27f9452a9 from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,093 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 9e86c21565a240f6b9183afdcf2bd41a from cloned region in snapshot testWithMockedMapReduceSingleRegion to table=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,095 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing d0ac20f8d2efe567a6ec0082cee49531, disabling compactions & flushes 2023-02-13 16:04:06,095 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,095 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,095 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. after waiting 0 ms 2023-02-13 16:04:06,095 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,095 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,095 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for d0ac20f8d2efe567a6ec0082cee49531: Waiting for close lock at 1676304246095Disabling compacts and flushes for region at 1676304246095Disabling writes for close at 1676304246095Writing region close event to WAL at 1676304246095Closed at 1676304246095 2023-02-13 16:04:06,095 INFO [Listener at localhost/33299] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMockedMapReduceSingleRegion" table: "testWithMockedMapReduceSingleRegion" creation_time: 1676304245473 type: FLUSH version: 2 ttl: 0 2023-02-13 16:04:06,095 DEBUG [Listener at localhost/33299] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:36123/user/jenkins/test-data/7099ab00-4125-f633-d814-85cbfe603ab9/testWithMockedMapReduceSingleRegion/9e4a8627-19a9-45c7-b168-e002679d318d 2023-02-13 16:04:06,095 DEBUG [Listener at localhost/33299] util.CommonFSUtils(682): File system contents for path hdfs://localhost:36123/user/jenkins/test-data/7099ab00-4125-f633-d814-85cbfe603ab9/testWithMockedMapReduceSingleRegion/9e4a8627-19a9-45c7-b168-e002679d318d 2023-02-13 16:04:06,096 DEBUG [Listener at localhost/33299] util.CommonFSUtils(699): |-data/ 2023-02-13 16:04:06,096 DEBUG [Listener at localhost/33299] util.CommonFSUtils(699): |----default/ 2023-02-13 16:04:06,096 DEBUG [Listener at localhost/33299] util.CommonFSUtils(699): |-------testWithMockedMapReduceSingleRegion/ 2023-02-13 16:04:06,097 DEBUG [Listener at localhost/33299] util.CommonFSUtils(699): |----------d0ac20f8d2efe567a6ec0082cee49531/ 2023-02-13 16:04:06,097 DEBUG [Listener at localhost/33299] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:06,097 DEBUG [Listener at localhost/33299] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:06,097 DEBUG [Listener at localhost/33299] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=d0ac20f8d2efe567a6ec0082cee49531-853f726cfa0d47e380d339e27f9452a9 2023-02-13 16:04:06,097 DEBUG [Listener at localhost/33299] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:06,098 DEBUG [Listener at localhost/33299] util.CommonFSUtils(702): |----------------testWithMockedMapReduceSingleRegion=d0ac20f8d2efe567a6ec0082cee49531-9e86c21565a240f6b9183afdcf2bd41a 2023-02-13 16:04:06,101 INFO [Listener at localhost/33299] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 16:04:06,104 DEBUG [Listener at localhost/33299] regionserver.HRegion(865): Instantiated testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:06,104 INFO [Listener at localhost/33299] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:06,105 DEBUG [Listener at localhost/33299] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:06,106 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:06,107 DEBUG [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/7099ab00-4125-f633-d814-85cbfe603ab9/testWithMockedMapReduceSingleRegion/9e4a8627-19a9-45c7-b168-e002679d318d/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1 2023-02-13 16:04:06,108 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0ac20f8d2efe567a6ec0082cee49531 columnFamilyName f1 2023-02-13 16:04:06,111 DEBUG [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] regionserver.HStore(539): loaded hdfs://localhost:36123/user/jenkins/test-data/7099ab00-4125-f633-d814-85cbfe603ab9/testWithMockedMapReduceSingleRegion/9e4a8627-19a9-45c7-b168-e002679d318d/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/testWithMockedMapReduceSingleRegion=d0ac20f8d2efe567a6ec0082cee49531-853f726cfa0d47e380d339e27f9452a9 2023-02-13 16:04:06,111 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] regionserver.HStore(310): Store=d0ac20f8d2efe567a6ec0082cee49531/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:06,111 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:06,112 DEBUG [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36123/user/jenkins/test-data/7099ab00-4125-f633-d814-85cbfe603ab9/testWithMockedMapReduceSingleRegion/9e4a8627-19a9-45c7-b168-e002679d318d/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2 2023-02-13 16:04:06,112 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0ac20f8d2efe567a6ec0082cee49531 columnFamilyName f2 2023-02-13 16:04:06,116 DEBUG [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] regionserver.HStore(539): loaded hdfs://localhost:36123/user/jenkins/test-data/7099ab00-4125-f633-d814-85cbfe603ab9/testWithMockedMapReduceSingleRegion/9e4a8627-19a9-45c7-b168-e002679d318d/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/testWithMockedMapReduceSingleRegion=d0ac20f8d2efe567a6ec0082cee49531-9e86c21565a240f6b9183afdcf2bd41a 2023-02-13 16:04:06,116 INFO [StoreOpener-d0ac20f8d2efe567a6ec0082cee49531-1] regionserver.HStore(310): Store=d0ac20f8d2efe567a6ec0082cee49531/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:06,116 DEBUG [Listener at localhost/33299] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMockedMapReduceSingleRegion descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:06,116 INFO [Listener at localhost/33299] regionserver.HRegion(1071): Opened d0ac20f8d2efe567a6ec0082cee49531; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59989548, jitterRate=-0.10608607530593872}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:06,116 DEBUG [Listener at localhost/33299] regionserver.HRegion(964): Region open journal for d0ac20f8d2efe567a6ec0082cee49531: Writing region info on filesystem at 1676304246105Initializing all the Stores at 1676304246105Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304246105Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304246105Region opened successfully at 1676304246116 (+11 ms) 2023-02-13 16:04:06,161 DEBUG [Listener at localhost/33299] regionserver.HRegion(1603): Closing d0ac20f8d2efe567a6ec0082cee49531, disabling compactions & flushes 2023-02-13 16:04:06,161 INFO [Listener at localhost/33299] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,161 DEBUG [Listener at localhost/33299] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,161 DEBUG [Listener at localhost/33299] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. after waiting 0 ms 2023-02-13 16:04:06,161 DEBUG [Listener at localhost/33299] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,162 INFO [Listener at localhost/33299] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,162 DEBUG [Listener at localhost/33299] regionserver.HRegion(1557): Region close journal for d0ac20f8d2efe567a6ec0082cee49531: Waiting for close lock at 1676304246161Disabling compacts and flushes for region at 1676304246161Disabling writes for close at 1676304246161Writing region close event to WAL at 1676304246162 (+1 ms)Closed at 1676304246162 2023-02-13 16:04:06,166 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMockedMapReduceSingleRegion" 2023-02-13 16:04:06,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] snapshot.SnapshotManager(333): Deleting snapshot: testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,169 INFO [Listener at localhost/33299] client.HBaseAdmin$15(890): Started disable of testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,170 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:04:06,176 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304246176"}]},"ts":"1676304246176"} 2023-02-13 16:04:06,177 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLING in hbase:meta 2023-02-13 16:04:06,179 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMockedMapReduceSingleRegion to state=DISABLING 2023-02-13 16:04:06,180 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d0ac20f8d2efe567a6ec0082cee49531, UNASSIGN}] 2023-02-13 16:04:06,181 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d0ac20f8d2efe567a6ec0082cee49531, UNASSIGN 2023-02-13 16:04:06,182 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d0ac20f8d2efe567a6ec0082cee49531, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:06,182 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676304246182"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304246182"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304246182"}]},"ts":"1676304246182"} 2023-02-13 16:04:06,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure d0ac20f8d2efe567a6ec0082cee49531, server=jenkins-hbase4.apache.org,45937,1676304243660}] 2023-02-13 16:04:06,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:04:06,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:06,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing d0ac20f8d2efe567a6ec0082cee49531, disabling compactions & flushes 2023-02-13 16:04:06,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. after waiting 0 ms 2023-02-13 16:04:06,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:06,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531. 2023-02-13 16:04:06,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for d0ac20f8d2efe567a6ec0082cee49531: Waiting for close lock at 1676304246336Running coprocessor pre-close hooks at 1676304246336Disabling compacts and flushes for region at 1676304246336Disabling writes for close at 1676304246336Writing region close event to WAL at 1676304246337 (+1 ms)Running coprocessor post-close hooks at 1676304246340 (+3 ms)Closed at 1676304246340 2023-02-13 16:04:06,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:06,342 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d0ac20f8d2efe567a6ec0082cee49531, regionState=CLOSED 2023-02-13 16:04:06,342 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676304246342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304246342"}]},"ts":"1676304246342"} 2023-02-13 16:04:06,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 16:04:06,345 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure d0ac20f8d2efe567a6ec0082cee49531, server=jenkins-hbase4.apache.org,45937,1676304243660 in 161 msec 2023-02-13 16:04:06,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 16:04:06,346 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMockedMapReduceSingleRegion, region=d0ac20f8d2efe567a6ec0082cee49531, UNASSIGN in 165 msec 2023-02-13 16:04:06,347 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304246347"}]},"ts":"1676304246347"} 2023-02-13 16:04:06,348 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMockedMapReduceSingleRegion, state=DISABLED in hbase:meta 2023-02-13 16:04:06,349 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMockedMapReduceSingleRegion to state=DISABLED 2023-02-13 16:04:06,350 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMockedMapReduceSingleRegion in 180 msec 2023-02-13 16:04:06,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:04:06,476 INFO [Listener at localhost/33299] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 15 completed 2023-02-13 16:04:06,477 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,479 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,479 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 16:04:06,482 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:06,484 DEBUG [HFileArchiver-7] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1, FileablePath, hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2, FileablePath, hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/recovered.edits] 2023-02-13 16:04:06,486 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/6b1195937e2c4f2e8efb49cd5de67787 to hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/archive/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/6b1195937e2c4f2e8efb49cd5de67787 2023-02-13 16:04:06,488 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/853f726cfa0d47e380d339e27f9452a9 to hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/archive/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f1/853f726cfa0d47e380d339e27f9452a9 2023-02-13 16:04:06,490 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/1f5fe409123240e39112bca483b9d696 to hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/archive/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/1f5fe409123240e39112bca483b9d696 2023-02-13 16:04:06,491 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/9e86c21565a240f6b9183afdcf2bd41a to hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/archive/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/f2/9e86c21565a240f6b9183afdcf2bd41a 2023-02-13 16:04:06,493 DEBUG [HFileArchiver-7] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/recovered.edits/12.seqid to hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/archive/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531/recovered.edits/12.seqid 2023-02-13 16:04:06,493 DEBUG [HFileArchiver-7] backup.HFileArchiver(596): Deleted hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/.tmp/data/default/testWithMockedMapReduceSingleRegion/d0ac20f8d2efe567a6ec0082cee49531 2023-02-13 16:04:06,493 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testWithMockedMapReduceSingleRegion regions 2023-02-13 16:04:06,495 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,497 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMockedMapReduceSingleRegion from hbase:meta 2023-02-13 16:04:06,498 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testWithMockedMapReduceSingleRegion' descriptor. 2023-02-13 16:04:06,498 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,498 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testWithMockedMapReduceSingleRegion' from region states. 2023-02-13 16:04:06,499 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304246498"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:06,500 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 16:04:06,500 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d0ac20f8d2efe567a6ec0082cee49531, NAME => 'testWithMockedMapReduceSingleRegion,,1676304244732.d0ac20f8d2efe567a6ec0082cee49531.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 16:04:06,500 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testWithMockedMapReduceSingleRegion' as deleted. 2023-02-13 16:04:06,500 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMockedMapReduceSingleRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676304246500"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:06,501 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testWithMockedMapReduceSingleRegion state from META 2023-02-13 16:04:06,502 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion 2023-02-13 16:04:06,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMockedMapReduceSingleRegion in 25 msec 2023-02-13 16:04:06,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35303] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 16:04:06,585 INFO [Listener at localhost/33299] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMockedMapReduceSingleRegion, procId: 18 completed 2023-02-13 16:04:06,585 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 16:04:06,585 INFO [Listener at localhost/33299] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 16:04:06,586 DEBUG [Listener at localhost/33299] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6694bb79 to 127.0.0.1:52886 2023-02-13 16:04:06,586 DEBUG [Listener at localhost/33299] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:06,586 DEBUG [Listener at localhost/33299] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 16:04:06,586 DEBUG [Listener at localhost/33299] util.JVMClusterUtil(257): Found active master hash=2035567668, stopped=false 2023-02-13 16:04:06,586 INFO [Listener at localhost/33299] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35303,1676304243610 2023-02-13 16:04:06,588 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:06,588 INFO [Listener at localhost/33299] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 16:04:06,588 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:06,588 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:06,588 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:06,590 DEBUG [Listener at localhost/33299] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x066724b9 to 127.0.0.1:52886 2023-02-13 16:04:06,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:06,590 DEBUG [Listener at localhost/33299] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:06,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:06,590 INFO [Listener at localhost/33299] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,45937,1676304243660' ***** 2023-02-13 16:04:06,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:06,590 INFO [Listener at localhost/33299] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:04:06,590 INFO [Listener at localhost/33299] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44171,1676304243690' ***** 2023-02-13 16:04:06,590 INFO [Listener at localhost/33299] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:04:06,590 INFO [RS:0;jenkins-hbase4:45937] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:04:06,590 INFO [RS:1;jenkins-hbase4:44171] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:04:06,591 INFO [RS:1;jenkins-hbase4:44171] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:04:06,591 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:04:06,591 INFO [RS:1;jenkins-hbase4:44171] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:04:06,591 INFO [RS:0;jenkins-hbase4:45937] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:04:06,591 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:04:06,591 INFO [RS:0;jenkins-hbase4:45937] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:04:06,591 INFO [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(3304): Received CLOSE for 811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:06,592 INFO [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:06,593 DEBUG [RS:0;jenkins-hbase4:45937] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14b6df76 to 127.0.0.1:52886 2023-02-13 16:04:06,593 DEBUG [RS:0;jenkins-hbase4:45937] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:06,593 INFO [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:06,593 INFO [RS:0;jenkins-hbase4:45937] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:04:06,593 INFO [RS:0;jenkins-hbase4:45937] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:04:06,593 INFO [RS:0;jenkins-hbase4:45937] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:04:06,593 DEBUG [RS:1;jenkins-hbase4:44171] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50f85125 to 127.0.0.1:52886 2023-02-13 16:04:06,593 INFO [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 16:04:06,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 811e1f412e46585a01fcb83b6989e895, disabling compactions & flushes 2023-02-13 16:04:06,593 INFO [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 16:04:06,593 DEBUG [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 16:04:06,593 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:04:06,593 DEBUG [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 16:04:06,593 DEBUG [RS:1;jenkins-hbase4:44171] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:06,593 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:04:06,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:06,594 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:04:06,593 INFO [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 16:04:06,594 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:04:06,594 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:04:06,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:06,594 DEBUG [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1479): Online Regions={811e1f412e46585a01fcb83b6989e895=hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895.} 2023-02-13 16:04:06,594 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.21 KB heapSize=7.63 KB 2023-02-13 16:04:06,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. after waiting 0 ms 2023-02-13 16:04:06,594 DEBUG [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1505): Waiting on 811e1f412e46585a01fcb83b6989e895 2023-02-13 16:04:06,594 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:06,594 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 811e1f412e46585a01fcb83b6989e895 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 16:04:06,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895/.tmp/info/7fe5900e08fa4ac0930c9f3cdce739af 2023-02-13 16:04:06,603 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.57 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/.tmp/info/a2e805368fd94b8590bf0dedaa2c7990 2023-02-13 16:04:06,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2e805368fd94b8590bf0dedaa2c7990 2023-02-13 16:04:06,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895/.tmp/info/7fe5900e08fa4ac0930c9f3cdce739af as hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895/info/7fe5900e08fa4ac0930c9f3cdce739af 2023-02-13 16:04:06,610 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895/info/7fe5900e08fa4ac0930c9f3cdce739af, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 16:04:06,611 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 811e1f412e46585a01fcb83b6989e895 in 17ms, sequenceid=6, compaction requested=false 2023-02-13 16:04:06,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=115 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/.tmp/rep_barrier/aa3454e501134493b13cb5961f5fd6e8 2023-02-13 16:04:06,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/namespace/811e1f412e46585a01fcb83b6989e895/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 16:04:06,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:06,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 811e1f412e46585a01fcb83b6989e895: Waiting for close lock at 1676304246593Running coprocessor pre-close hooks at 1676304246593Disabling compacts and flushes for region at 1676304246593Disabling writes for close at 1676304246594 (+1 ms)Obtaining lock to block concurrent updates at 1676304246594Preparing flush snapshotting stores in 811e1f412e46585a01fcb83b6989e895 at 1676304246594Finished memstore snapshotting hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676304246594Flushing stores of hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. at 1676304246595 (+1 ms)Flushing 811e1f412e46585a01fcb83b6989e895/info: creating writer at 1676304246595Flushing 811e1f412e46585a01fcb83b6989e895/info: appending metadata at 1676304246596 (+1 ms)Flushing 811e1f412e46585a01fcb83b6989e895/info: closing flushed file at 1676304246596Flushing 811e1f412e46585a01fcb83b6989e895/info: reopening flushed file at 1676304246607 (+11 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 811e1f412e46585a01fcb83b6989e895 in 17ms, sequenceid=6, compaction requested=false at 1676304246611 (+4 ms)Writing region close event to WAL at 1676304246616 (+5 ms)Running coprocessor post-close hooks at 1676304246619 (+3 ms)Closed at 1676304246619 2023-02-13 16:04:06,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676304244241.811e1f412e46585a01fcb83b6989e895. 2023-02-13 16:04:06,622 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa3454e501134493b13cb5961f5fd6e8 2023-02-13 16:04:06,629 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=536 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/.tmp/table/ddd8a44b6d914d02a05cb4084bb362b6 2023-02-13 16:04:06,632 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ddd8a44b6d914d02a05cb4084bb362b6 2023-02-13 16:04:06,633 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/.tmp/info/a2e805368fd94b8590bf0dedaa2c7990 as hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/info/a2e805368fd94b8590bf0dedaa2c7990 2023-02-13 16:04:06,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2e805368fd94b8590bf0dedaa2c7990 2023-02-13 16:04:06,636 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/info/a2e805368fd94b8590bf0dedaa2c7990, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 16:04:06,637 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/.tmp/rep_barrier/aa3454e501134493b13cb5961f5fd6e8 as hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/rep_barrier/aa3454e501134493b13cb5961f5fd6e8 2023-02-13 16:04:06,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa3454e501134493b13cb5961f5fd6e8 2023-02-13 16:04:06,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/rep_barrier/aa3454e501134493b13cb5961f5fd6e8, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 16:04:06,641 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/.tmp/table/ddd8a44b6d914d02a05cb4084bb362b6 as hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/table/ddd8a44b6d914d02a05cb4084bb362b6 2023-02-13 16:04:06,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ddd8a44b6d914d02a05cb4084bb362b6 2023-02-13 16:04:06,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/table/ddd8a44b6d914d02a05cb4084bb362b6, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 16:04:06,647 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false 2023-02-13 16:04:06,651 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 16:04:06,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 16:04:06,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:06,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304246593Running coprocessor pre-close hooks at 1676304246593Disabling compacts and flushes for region at 1676304246593Disabling writes for close at 1676304246594 (+1 ms)Obtaining lock to block concurrent updates at 1676304246594Preparing flush snapshotting stores in 1588230740 at 1676304246594Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4311, getHeapSize=7760, getOffHeapSize=0, getCellsCount=36 at 1676304246594Flushing stores of hbase:meta,,1.1588230740 at 1676304246594Flushing 1588230740/info: creating writer at 1676304246595 (+1 ms)Flushing 1588230740/info: appending metadata at 1676304246597 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676304246597Flushing 1588230740/rep_barrier: creating writer at 1676304246606 (+9 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676304246608 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676304246608Flushing 1588230740/table: creating writer at 1676304246622 (+14 ms)Flushing 1588230740/table: appending metadata at 1676304246623 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676304246623Flushing 1588230740/info: reopening flushed file at 1676304246634 (+11 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676304246637 (+3 ms)Flushing 1588230740/table: reopening flushed file at 1676304246641 (+4 ms)Finished flush of dataSize ~4.21 KB/4311, heapSize ~7.58 KB/7760, currentSize=0 B/0 for 1588230740 in 53ms, sequenceid=21, compaction requested=false at 1676304246647 (+6 ms)Writing region close event to WAL at 1676304246649 (+2 ms)Running coprocessor post-close hooks at 1676304246652 (+3 ms)Closed at 1676304246652 2023-02-13 16:04:06,652 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:06,668 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:06,670 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:06,794 INFO [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,45937,1676304243660; all regions closed. 2023-02-13 16:04:06,794 INFO [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44171,1676304243690; all regions closed. 2023-02-13 16:04:06,798 DEBUG [RS:1;jenkins-hbase4:44171] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/oldWALs 2023-02-13 16:04:06,798 DEBUG [RS:0;jenkins-hbase4:45937] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/oldWALs 2023-02-13 16:04:06,798 INFO [RS:0;jenkins-hbase4:45937] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45937%2C1676304243660.meta:.meta(num 1676304244188) 2023-02-13 16:04:06,798 INFO [RS:1;jenkins-hbase4:44171] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44171%2C1676304243690:(num 1676304244586) 2023-02-13 16:04:06,798 DEBUG [RS:1;jenkins-hbase4:44171] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:06,798 INFO [RS:1;jenkins-hbase4:44171] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:06,798 INFO [RS:1;jenkins-hbase4:44171] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 16:04:06,798 INFO [RS:1;jenkins-hbase4:44171] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:04:06,798 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:06,798 INFO [RS:1;jenkins-hbase4:44171] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:04:06,799 INFO [RS:1;jenkins-hbase4:44171] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:04:06,800 INFO [RS:1;jenkins-hbase4:44171] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44171 2023-02-13 16:04:06,804 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:06,804 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:06,804 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:06,804 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44171,1676304243690] 2023-02-13 16:04:06,804 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44171,1676304243690 2023-02-13 16:04:06,804 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44171,1676304243690; numProcessing=1 2023-02-13 16:04:06,805 ERROR [Listener at localhost/33299-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@456b7b18 rejected from java.util.concurrent.ThreadPoolExecutor@4154e76d[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:06,805 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:06,805 ERROR [Listener at localhost/33299-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2bb5c9d0 rejected from java.util.concurrent.ThreadPoolExecutor@4154e76d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:06,806 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44171,1676304243690 already deleted, retry=false 2023-02-13 16:04:06,806 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44171,1676304243690 expired; onlineServers=1 2023-02-13 16:04:06,806 DEBUG [RS:0;jenkins-hbase4:45937] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/oldWALs 2023-02-13 16:04:06,806 INFO [RS:0;jenkins-hbase4:45937] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45937%2C1676304243660:(num 1676304244992) 2023-02-13 16:04:06,806 DEBUG [RS:0;jenkins-hbase4:45937] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:06,806 INFO [RS:0;jenkins-hbase4:45937] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:06,806 INFO [RS:0;jenkins-hbase4:45937] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 16:04:06,806 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:06,807 INFO [RS:0;jenkins-hbase4:45937] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45937 2023-02-13 16:04:06,809 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45937,1676304243660 2023-02-13 16:04:06,809 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:06,809 ERROR [Listener at localhost/33299-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@13e960bf rejected from java.util.concurrent.ThreadPoolExecutor@17d6e61a[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:06,810 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45937,1676304243660] 2023-02-13 16:04:06,810 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45937,1676304243660; numProcessing=2 2023-02-13 16:04:06,811 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45937,1676304243660 already deleted, retry=false 2023-02-13 16:04:06,811 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45937,1676304243660 expired; onlineServers=0 2023-02-13 16:04:06,811 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35303,1676304243610' ***** 2023-02-13 16:04:06,811 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 16:04:06,812 DEBUG [M:0;jenkins-hbase4:35303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d6bc7c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:04:06,812 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35303,1676304243610 2023-02-13 16:04:06,812 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35303,1676304243610; all regions closed. 2023-02-13 16:04:06,812 DEBUG [M:0;jenkins-hbase4:35303] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:06,812 DEBUG [M:0;jenkins-hbase4:35303] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 16:04:06,812 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 16:04:06,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304243835] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304243835,5,FailOnTimeoutGroup] 2023-02-13 16:04:06,812 DEBUG [M:0;jenkins-hbase4:35303] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 16:04:06,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304243835] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304243835,5,FailOnTimeoutGroup] 2023-02-13 16:04:06,812 INFO [M:0;jenkins-hbase4:35303] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 16:04:06,813 INFO [M:0;jenkins-hbase4:35303] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 16:04:06,814 INFO [M:0;jenkins-hbase4:35303] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 16:04:06,814 DEBUG [M:0;jenkins-hbase4:35303] master.HMaster(1502): Stopping service threads 2023-02-13 16:04:06,814 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:06,814 INFO [M:0;jenkins-hbase4:35303] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 16:04:06,814 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:06,814 ERROR [M:0;jenkins-hbase4:35303] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 16:04:06,814 INFO [M:0;jenkins-hbase4:35303] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 16:04:06,814 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 16:04:06,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:06,815 DEBUG [M:0;jenkins-hbase4:35303] zookeeper.ZKUtil(398): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 16:04:06,815 WARN [M:0;jenkins-hbase4:35303] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 16:04:06,815 INFO [M:0;jenkins-hbase4:35303] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 16:04:06,815 INFO [M:0;jenkins-hbase4:35303] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 16:04:06,815 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:04:06,815 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:06,815 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:06,815 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:04:06,815 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:06,815 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.10 KB heapSize=67.06 KB 2023-02-13 16:04:06,825 INFO [M:0;jenkins-hbase4:35303] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.10 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dd91606e5f41479a8224839fb00e7216 2023-02-13 16:04:06,829 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/dd91606e5f41479a8224839fb00e7216 as hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dd91606e5f41479a8224839fb00e7216 2023-02-13 16:04:06,832 INFO [M:0;jenkins-hbase4:35303] regionserver.HStore(1080): Added hdfs://localhost:36123/user/jenkins/test-data/d276e0cd-9167-6d2a-f872-72d38993b5d5/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/dd91606e5f41479a8224839fb00e7216, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 16:04:06,833 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegion(2947): Finished flush of dataSize ~56.10 KB/57451, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false 2023-02-13 16:04:06,833 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:06,833 DEBUG [M:0;jenkins-hbase4:35303] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304246815Disabling compacts and flushes for region at 1676304246815Disabling writes for close at 1676304246815Obtaining lock to block concurrent updates at 1676304246815Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676304246815Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=57451, getHeapSize=68656, getOffHeapSize=0, getCellsCount=145 at 1676304246816 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676304246817 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676304246817Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676304246819 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676304246819Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676304246829 (+10 ms)Finished flush of dataSize ~56.10 KB/57451, heapSize ~67.05 KB/68656, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 18ms, sequenceid=132, compaction requested=false at 1676304246833 (+4 ms)Writing region close event to WAL at 1676304246833Closed at 1676304246833 2023-02-13 16:04:06,835 INFO [M:0;jenkins-hbase4:35303] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 16:04:06,835 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:06,836 INFO [M:0;jenkins-hbase4:35303] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35303 2023-02-13 16:04:06,838 DEBUG [M:0;jenkins-hbase4:35303] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35303,1676304243610 already deleted, retry=false 2023-02-13 16:04:07,090 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:07,090 INFO [M:0;jenkins-hbase4:35303] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35303,1676304243610; zookeeper connection closed. 2023-02-13 16:04:07,090 ERROR [Listener at localhost/33299-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6237f968 rejected from java.util.concurrent.ThreadPoolExecutor@660871f6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:07,091 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): master:35303-0x1004e6cc54c0000, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:07,091 ERROR [Listener at localhost/33299-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4f42f99e rejected from java.util.concurrent.ThreadPoolExecutor@660871f6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:07,190 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:07,190 INFO [RS:0;jenkins-hbase4:45937] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,45937,1676304243660; zookeeper connection closed. 2023-02-13 16:04:07,190 ERROR [Listener at localhost/33299-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b78f869 rejected from java.util.concurrent.ThreadPoolExecutor@17d6e61a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:07,190 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:45937-0x1004e6cc54c0001, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:07,191 ERROR [Listener at localhost/33299-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@438a5774 rejected from java.util.concurrent.ThreadPoolExecutor@17d6e61a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:07,191 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3b16ecaa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3b16ecaa 2023-02-13 16:04:07,291 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:07,291 INFO [RS:1;jenkins-hbase4:44171] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44171,1676304243690; zookeeper connection closed. 2023-02-13 16:04:07,291 ERROR [Listener at localhost/33299-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@53913254 rejected from java.util.concurrent.ThreadPoolExecutor@4154e76d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:07,291 DEBUG [Listener at localhost/33299-EventThread] zookeeper.ZKWatcher(600): regionserver:44171-0x1004e6cc54c0002, quorum=127.0.0.1:52886, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:07,291 ERROR [Listener at localhost/33299-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6187307a rejected from java.util.concurrent.ThreadPoolExecutor@4154e76d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:07,291 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f1fc986] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f1fc986 2023-02-13 16:04:07,292 INFO [Listener at localhost/33299] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 16:04:07,292 WARN [Listener at localhost/33299] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:04:07,296 INFO [Listener at localhost/33299] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:07,400 WARN [BP-1152467254-172.31.14.131-1676304242966 heartbeating to localhost/127.0.0.1:36123] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:04:07,400 WARN [BP-1152467254-172.31.14.131-1676304242966 heartbeating to localhost/127.0.0.1:36123] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1152467254-172.31.14.131-1676304242966 (Datanode Uuid b9efda07-8d1a-47f5-9dff-e41e2b0b3745) service to localhost/127.0.0.1:36123 2023-02-13 16:04:07,401 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/cluster_6bed958b-65c2-2ac9-acc3-76d137ef4961/dfs/data/data3/current/BP-1152467254-172.31.14.131-1676304242966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:07,401 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/cluster_6bed958b-65c2-2ac9-acc3-76d137ef4961/dfs/data/data4/current/BP-1152467254-172.31.14.131-1676304242966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:07,402 WARN [Listener at localhost/33299] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:04:07,405 INFO [Listener at localhost/33299] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:07,508 WARN [BP-1152467254-172.31.14.131-1676304242966 heartbeating to localhost/127.0.0.1:36123] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:04:07,509 WARN [BP-1152467254-172.31.14.131-1676304242966 heartbeating to localhost/127.0.0.1:36123] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1152467254-172.31.14.131-1676304242966 (Datanode Uuid 51e3c73b-08a9-499b-b49e-6da54cd21fd5) service to localhost/127.0.0.1:36123 2023-02-13 16:04:07,509 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/cluster_6bed958b-65c2-2ac9-acc3-76d137ef4961/dfs/data/data1/current/BP-1152467254-172.31.14.131-1676304242966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:07,510 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/cluster_6bed958b-65c2-2ac9-acc3-76d137ef4961/dfs/data/data2/current/BP-1152467254-172.31.14.131-1676304242966] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:07,519 INFO [Listener at localhost/33299] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:07,632 INFO [Listener at localhost/33299] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 16:04:07,650 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 16:04:07,662 INFO [Listener at localhost/33299] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMockedMapReduceSingleRegion Thread=254 (was 230) Potentially hanging thread: nioEventLoopGroup-21-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.9@localhost:36123 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:36123 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-16-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33299 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:36123 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.8@localhost:36123 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/33299.LruBlockCache.EvictionThread java.lang.Object.wait(Native Method) org.apache.hadoop.hbase.io.hfile.LruBlockCache$EvictionThread.run(LruBlockCache.java:902) Potentially hanging thread: RS-EventLoopGroup-17-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-16-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:36123 from jenkins.hfs.8 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-21-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:36123 from jenkins.hfs.9 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-14 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:36123 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-18-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-19-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-13 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-17-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-15-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'NameNode' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: nioEventLoopGroup-21-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35303,1676304243610)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-20-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=643 (was 626) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=287 (was 304), ProcessCount=165 (was 165), AvailableMemoryMB=1455 (was 1498) 2023-02-13 16:04:07,672 INFO [Listener at localhost/33299] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=254, OpenFileDescriptor=643, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=165, AvailableMemoryMB=1455 2023-02-13 16:04:07,682 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/hadoop.log.dir so I do NOT create it in target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176 2023-02-13 16:04:07,682 WARN [Listener at localhost/33299] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 16:04:07,682 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/hadoop.tmp.dir so I do NOT create it in target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176 2023-02-13 16:04:07,682 WARN [Listener at localhost/33299] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/90b1ec65-1d5e-37c3-ddf3-cd895fc60c72/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 16:04:07,683 DEBUG [Listener at localhost/33299] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176 2023-02-13 16:04:07,683 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 16:04:07,683 INFO [Listener at localhost/33299] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/cluster_816c9471-fd3a-bb7f-a542-3b8d9878c365, deleteOnExit=true 2023-02-13 16:04:07,683 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 16:04:07,683 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/test.cache.data in system properties and HBase conf 2023-02-13 16:04:07,683 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 16:04:07,683 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/hadoop.log.dir in system properties and HBase conf 2023-02-13 16:04:07,683 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 16:04:07,683 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 16:04:07,683 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 16:04:07,684 DEBUG [Listener at localhost/33299] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 16:04:07,684 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:04:07,684 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:04:07,684 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 16:04:07,684 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:04:07,684 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 16:04:07,684 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 16:04:07,684 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:04:07,684 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:04:07,685 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 16:04:07,685 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/nfs.dump.dir in system properties and HBase conf 2023-02-13 16:04:07,685 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/java.io.tmpdir in system properties and HBase conf 2023-02-13 16:04:07,685 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:04:07,685 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 16:04:07,685 INFO [Listener at localhost/33299] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 16:04:07,717 WARN [Listener at localhost/33299] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:04:07,717 WARN [Listener at localhost/33299] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:04:07,754 WARN [Listener at localhost/33299] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:04:07,757 INFO [Listener at localhost/33299] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:04:07,763 INFO [Listener at localhost/33299] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/java.io.tmpdir/Jetty_localhost_34347_hdfs____uo5c4f/webapp 2023-02-13 16:04:07,855 INFO [Listener at localhost/33299] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34347 2023-02-13 16:04:07,859 WARN [Listener at localhost/33299] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:04:07,859 WARN [Listener at localhost/33299] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:04:07,900 WARN [Listener at localhost/45685] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:04:07,915 WARN [Listener at localhost/45685] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:04:07,917 WARN [Listener at localhost/45685] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:04:07,918 INFO [Listener at localhost/45685] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:04:07,923 INFO [Listener at localhost/45685] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/java.io.tmpdir/Jetty_localhost_45081_datanode____.tsb8k1/webapp 2023-02-13 16:04:08,014 INFO [Listener at localhost/45685] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45081 2023-02-13 16:04:08,022 WARN [Listener at localhost/42057] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:04:08,036 WARN [Listener at localhost/42057] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:04:08,039 WARN [Listener at localhost/42057] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:04:08,040 INFO [Listener at localhost/42057] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:04:08,046 INFO [Listener at localhost/42057] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/java.io.tmpdir/Jetty_localhost_39733_datanode____.ldkzjc/webapp 2023-02-13 16:04:08,129 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfb56ea5c1d384a66: Processing first storage report for DS-b5272031-c965-4e04-955b-a16c83819a07 from datanode 78e17e21-7a61-44ec-8f6f-4f7a8d26eeee 2023-02-13 16:04:08,129 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfb56ea5c1d384a66: from storage DS-b5272031-c965-4e04-955b-a16c83819a07 node DatanodeRegistration(127.0.0.1:41553, datanodeUuid=78e17e21-7a61-44ec-8f6f-4f7a8d26eeee, infoPort=35255, infoSecurePort=0, ipcPort=42057, storageInfo=lv=-57;cid=testClusterID;nsid=695763001;c=1676304247720), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:08,129 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfb56ea5c1d384a66: Processing first storage report for DS-569a80f8-ac3e-4871-aa68-1cf761935f8c from datanode 78e17e21-7a61-44ec-8f6f-4f7a8d26eeee 2023-02-13 16:04:08,129 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfb56ea5c1d384a66: from storage DS-569a80f8-ac3e-4871-aa68-1cf761935f8c node DatanodeRegistration(127.0.0.1:41553, datanodeUuid=78e17e21-7a61-44ec-8f6f-4f7a8d26eeee, infoPort=35255, infoSecurePort=0, ipcPort=42057, storageInfo=lv=-57;cid=testClusterID;nsid=695763001;c=1676304247720), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:08,161 INFO [Listener at localhost/42057] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39733 2023-02-13 16:04:08,169 WARN [Listener at localhost/40929] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:04:08,262 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9c0497e8db4bf6e1: Processing first storage report for DS-21236228-a2c2-406d-94d7-4e43fd2885f5 from datanode 29b53ebb-a723-492f-ae24-4238b722c589 2023-02-13 16:04:08,262 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9c0497e8db4bf6e1: from storage DS-21236228-a2c2-406d-94d7-4e43fd2885f5 node DatanodeRegistration(127.0.0.1:39467, datanodeUuid=29b53ebb-a723-492f-ae24-4238b722c589, infoPort=36387, infoSecurePort=0, ipcPort=40929, storageInfo=lv=-57;cid=testClusterID;nsid=695763001;c=1676304247720), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:08,262 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9c0497e8db4bf6e1: Processing first storage report for DS-595f3ec1-0f0e-4e3d-99af-fa213130d068 from datanode 29b53ebb-a723-492f-ae24-4238b722c589 2023-02-13 16:04:08,262 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9c0497e8db4bf6e1: from storage DS-595f3ec1-0f0e-4e3d-99af-fa213130d068 node DatanodeRegistration(127.0.0.1:39467, datanodeUuid=29b53ebb-a723-492f-ae24-4238b722c589, infoPort=36387, infoSecurePort=0, ipcPort=40929, storageInfo=lv=-57;cid=testClusterID;nsid=695763001;c=1676304247720), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:08,274 DEBUG [Listener at localhost/40929] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176 2023-02-13 16:04:08,280 INFO [Listener at localhost/40929] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/cluster_816c9471-fd3a-bb7f-a542-3b8d9878c365/zookeeper_0, clientPort=64776, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/cluster_816c9471-fd3a-bb7f-a542-3b8d9878c365/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/cluster_816c9471-fd3a-bb7f-a542-3b8d9878c365/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 16:04:08,281 INFO [Listener at localhost/40929] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64776 2023-02-13 16:04:08,282 INFO [Listener at localhost/40929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,282 INFO [Listener at localhost/40929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,298 INFO [Listener at localhost/40929] util.FSUtils(479): Created version file at hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca with version=8 2023-02-13 16:04:08,298 INFO [Listener at localhost/40929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,299 INFO [Listener at localhost/40929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,300 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45685/user/jenkins/test-data/f3c47139-31c6-40e8-26c7-896f31a93614/hbase-staging 2023-02-13 16:04:08,302 INFO [Listener at localhost/40929] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:04:08,302 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:08,302 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:08,302 INFO [Listener at localhost/40929] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:04:08,302 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:08,302 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:04:08,302 INFO [Listener at localhost/40929] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:04:08,303 INFO [Listener at localhost/40929] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35089 2023-02-13 16:04:08,304 INFO [Listener at localhost/40929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,305 INFO [Listener at localhost/40929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,306 INFO [Listener at localhost/40929] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35089 connecting to ZooKeeper ensemble=127.0.0.1:64776 2023-02-13 16:04:08,314 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:350890x0, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:04:08,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:35089-0x1004e6cd7990000 connected 2023-02-13 16:04:08,335 DEBUG [Listener at localhost/40929] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:08,335 DEBUG [Listener at localhost/40929] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:08,335 DEBUG [Listener at localhost/40929] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:04:08,340 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35089 2023-02-13 16:04:08,340 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35089 2023-02-13 16:04:08,340 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35089 2023-02-13 16:04:08,344 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35089 2023-02-13 16:04:08,344 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35089 2023-02-13 16:04:08,344 INFO [Listener at localhost/40929] master.HMaster(439): hbase.rootdir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca, hbase.cluster.distributed=false 2023-02-13 16:04:08,356 INFO [Listener at localhost/40929] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:04:08,356 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:08,357 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:08,357 INFO [Listener at localhost/40929] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:04:08,357 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:08,357 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:04:08,357 INFO [Listener at localhost/40929] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:04:08,357 INFO [Listener at localhost/40929] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44365 2023-02-13 16:04:08,358 INFO [Listener at localhost/40929] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:04:08,358 DEBUG [Listener at localhost/40929] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:08,359 INFO [Listener at localhost/40929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,359 INFO [Listener at localhost/40929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,360 INFO [Listener at localhost/40929] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44365 connecting to ZooKeeper ensemble=127.0.0.1:64776 2023-02-13 16:04:08,364 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:443650x0, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:04:08,365 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:44365-0x1004e6cd7990001 connected 2023-02-13 16:04:08,365 DEBUG [Listener at localhost/40929] zookeeper.ZKUtil(164): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:08,365 DEBUG [Listener at localhost/40929] zookeeper.ZKUtil(164): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:08,366 DEBUG [Listener at localhost/40929] zookeeper.ZKUtil(164): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:04:08,368 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44365 2023-02-13 16:04:08,369 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44365 2023-02-13 16:04:08,371 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44365 2023-02-13 16:04:08,371 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44365 2023-02-13 16:04:08,372 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44365 2023-02-13 16:04:08,382 INFO [Listener at localhost/40929] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:04:08,383 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:08,383 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:08,383 INFO [Listener at localhost/40929] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:04:08,383 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:08,383 INFO [Listener at localhost/40929] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:04:08,383 INFO [Listener at localhost/40929] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:04:08,384 INFO [Listener at localhost/40929] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43979 2023-02-13 16:04:08,384 INFO [Listener at localhost/40929] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:04:08,385 DEBUG [Listener at localhost/40929] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:08,385 INFO [Listener at localhost/40929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,386 INFO [Listener at localhost/40929] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,387 INFO [Listener at localhost/40929] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43979 connecting to ZooKeeper ensemble=127.0.0.1:64776 2023-02-13 16:04:08,389 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:439790x0, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:04:08,389 DEBUG [Listener at localhost/40929] zookeeper.ZKUtil(164): regionserver:439790x0, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:08,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:43979-0x1004e6cd7990002 connected 2023-02-13 16:04:08,390 DEBUG [Listener at localhost/40929] zookeeper.ZKUtil(164): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:08,391 DEBUG [Listener at localhost/40929] zookeeper.ZKUtil(164): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:04:08,393 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43979 2023-02-13 16:04:08,393 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43979 2023-02-13 16:04:08,394 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43979 2023-02-13 16:04:08,399 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43979 2023-02-13 16:04:08,399 DEBUG [Listener at localhost/40929] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43979 2023-02-13 16:04:08,400 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35089,1676304248301 2023-02-13 16:04:08,402 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:04:08,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35089,1676304248301 2023-02-13 16:04:08,403 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:08,403 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:08,403 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:08,404 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:08,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:04:08,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35089,1676304248301 from backup master directory 2023-02-13 16:04:08,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:04:08,409 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35089,1676304248301 2023-02-13 16:04:08,409 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:04:08,409 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:04:08,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,35089,1676304248301 2023-02-13 16:04:08,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/hbase.id with ID: 920dc832-950a-4e8d-b441-b51dc6db438c 2023-02-13 16:04:08,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:08,432 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:08,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1583a075 to 127.0.0.1:64776 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:08,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31840e09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:08,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:08,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 16:04:08,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:08,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/data/master/store-tmp 2023-02-13 16:04:08,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:08,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:04:08,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:08,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:08,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:04:08,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:08,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:08,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304248453Disabling compacts and flushes for region at 1676304248453Disabling writes for close at 1676304248453Writing region close event to WAL at 1676304248453Closed at 1676304248453 2023-02-13 16:04:08,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/WALs/jenkins-hbase4.apache.org,35089,1676304248301 2023-02-13 16:04:08,455 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35089%2C1676304248301, suffix=, logDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/WALs/jenkins-hbase4.apache.org,35089,1676304248301, archiveDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/oldWALs, maxLogs=10 2023-02-13 16:04:08,467 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41553,DS-b5272031-c965-4e04-955b-a16c83819a07,DISK] 2023-02-13 16:04:08,467 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39467,DS-21236228-a2c2-406d-94d7-4e43fd2885f5,DISK] 2023-02-13 16:04:08,469 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/WALs/jenkins-hbase4.apache.org,35089,1676304248301/jenkins-hbase4.apache.org%2C35089%2C1676304248301.1676304248455 2023-02-13 16:04:08,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41553,DS-b5272031-c965-4e04-955b-a16c83819a07,DISK], DatanodeInfoWithStorage[127.0.0.1:39467,DS-21236228-a2c2-406d-94d7-4e43fd2885f5,DISK]] 2023-02-13 16:04:08,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:08,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:08,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:08,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:08,470 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:08,471 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 16:04:08,472 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 16:04:08,472 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:08,472 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:08,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:08,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:08,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:08,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74870431, jitterRate=0.11565636098384857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:04:08,476 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676304248469Initializing all the Stores at 1676304248470 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304248470Cleaning up temporary data from old regions at 1676304248473 (+3 ms)Cleaning up detritus from prior splits at 1676304248473Region opened successfully at 1676304248476 (+3 ms) 2023-02-13 16:04:08,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 16:04:08,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 16:04:08,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 16:04:08,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 16:04:08,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 16:04:08,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 16:04:08,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 16:04:08,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 16:04:08,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 16:04:08,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 16:04:08,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 16:04:08,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 16:04:08,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 16:04:08,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 16:04:08,499 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:08,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 16:04:08,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 16:04:08,500 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 16:04:08,502 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:08,502 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:08,502 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:08,503 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:08,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,35089,1676304248301, sessionid=0x1004e6cd7990000, setting cluster-up flag (Was=false) 2023-02-13 16:04:08,508 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:08,512 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 16:04:08,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35089,1676304248301 2023-02-13 16:04:08,515 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:08,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 16:04:08,520 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35089,1676304248301 2023-02-13 16:04:08,521 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.hbase-snapshot/.tmp 2023-02-13 16:04:08,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 16:04:08,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:08,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:08,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:08,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:08,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 16:04:08,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:04:08,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676304278525 2023-02-13 16:04:08,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 16:04:08,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 16:04:08,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 16:04:08,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 16:04:08,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 16:04:08,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 16:04:08,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,526 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:04:08,526 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 16:04:08,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 16:04:08,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 16:04:08,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 16:04:08,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 16:04:08,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 16:04:08,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304248527,5,FailOnTimeoutGroup] 2023-02-13 16:04:08,527 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304248527,5,FailOnTimeoutGroup] 2023-02-13 16:04:08,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 16:04:08,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,527 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:08,538 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:08,538 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:08,539 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca 2023-02-13 16:04:08,546 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:08,546 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:04:08,547 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/info 2023-02-13 16:04:08,548 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:04:08,548 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:08,548 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:04:08,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:04:08,549 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:04:08,550 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:08,550 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:04:08,550 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/table 2023-02-13 16:04:08,551 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:04:08,551 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:08,551 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740 2023-02-13 16:04:08,552 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740 2023-02-13 16:04:08,553 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:04:08,554 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:04:08,556 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:08,556 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60823875, jitterRate=-0.09365363419055939}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:04:08,557 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676304248546Initializing all the Stores at 1676304248546Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304248546Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304248546Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304248546Cleaning up temporary data from old regions at 1676304248552 (+6 ms)Cleaning up detritus from prior splits at 1676304248553 (+1 ms)Region opened successfully at 1676304248556 (+3 ms) 2023-02-13 16:04:08,557 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:04:08,557 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:04:08,557 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:04:08,557 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:04:08,557 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:04:08,557 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:08,557 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304248557Disabling compacts and flushes for region at 1676304248557Disabling writes for close at 1676304248557Writing region close event to WAL at 1676304248557Closed at 1676304248557 2023-02-13 16:04:08,558 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:04:08,558 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 16:04:08,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 16:04:08,559 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 16:04:08,561 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 16:04:08,601 INFO [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(952): ClusterId : 920dc832-950a-4e8d-b441-b51dc6db438c 2023-02-13 16:04:08,601 INFO [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(952): ClusterId : 920dc832-950a-4e8d-b441-b51dc6db438c 2023-02-13 16:04:08,601 DEBUG [RS:1;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:04:08,601 DEBUG [RS:0;jenkins-hbase4:44365] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:04:08,603 DEBUG [RS:0;jenkins-hbase4:44365] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:04:08,603 DEBUG [RS:1;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:04:08,603 DEBUG [RS:1;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:04:08,603 DEBUG [RS:0;jenkins-hbase4:44365] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:04:08,606 DEBUG [RS:0;jenkins-hbase4:44365] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:04:08,606 DEBUG [RS:1;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:04:08,608 DEBUG [RS:0;jenkins-hbase4:44365] zookeeper.ReadOnlyZKClient(139): Connect 0x367fb85f to 127.0.0.1:64776 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:08,608 DEBUG [RS:1;jenkins-hbase4:43979] zookeeper.ReadOnlyZKClient(139): Connect 0x38c6567f to 127.0.0.1:64776 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:08,610 DEBUG [RS:1;jenkins-hbase4:43979] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3601af17, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:08,610 DEBUG [RS:0;jenkins-hbase4:44365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38b850e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:08,610 DEBUG [RS:1;jenkins-hbase4:43979] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@323e3d0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:04:08,610 DEBUG [RS:0;jenkins-hbase4:44365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c87d32f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:04:08,619 DEBUG [RS:1;jenkins-hbase4:43979] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43979 2023-02-13 16:04:08,619 DEBUG [RS:0;jenkins-hbase4:44365] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44365 2023-02-13 16:04:08,619 INFO [RS:1;jenkins-hbase4:43979] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:04:08,619 INFO [RS:0;jenkins-hbase4:44365] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:04:08,619 INFO [RS:0;jenkins-hbase4:44365] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:04:08,619 INFO [RS:1;jenkins-hbase4:43979] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:04:08,619 DEBUG [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:04:08,619 DEBUG [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:04:08,620 INFO [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35089,1676304248301 with isa=jenkins-hbase4.apache.org/172.31.14.131:44365, startcode=1676304248356 2023-02-13 16:04:08,620 INFO [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,35089,1676304248301 with isa=jenkins-hbase4.apache.org/172.31.14.131:43979, startcode=1676304248382 2023-02-13 16:04:08,620 DEBUG [RS:0;jenkins-hbase4:44365] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:04:08,620 DEBUG [RS:1;jenkins-hbase4:43979] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:04:08,621 INFO [RS-EventLoopGroup-18-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32887, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.11 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:04:08,622 INFO [RS-EventLoopGroup-18-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35599, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.10 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:04:08,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35089] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:08,623 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:08,624 DEBUG [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca 2023-02-13 16:04:08,624 DEBUG [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45685 2023-02-13 16:04:08,624 DEBUG [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:04:08,624 DEBUG [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca 2023-02-13 16:04:08,624 DEBUG [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:45685 2023-02-13 16:04:08,624 DEBUG [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:04:08,625 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:08,629 DEBUG [RS:1;jenkins-hbase4:43979] zookeeper.ZKUtil(162): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:08,629 WARN [RS:1;jenkins-hbase4:43979] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:04:08,629 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44365,1676304248356] 2023-02-13 16:04:08,629 INFO [RS:1;jenkins-hbase4:43979] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:08,629 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43979,1676304248382] 2023-02-13 16:04:08,629 DEBUG [RS:0;jenkins-hbase4:44365] zookeeper.ZKUtil(162): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:08,629 DEBUG [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/WALs/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:08,629 WARN [RS:0;jenkins-hbase4:44365] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:04:08,629 INFO [RS:0;jenkins-hbase4:44365] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:08,630 DEBUG [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1947): logDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/WALs/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:08,634 DEBUG [RS:1;jenkins-hbase4:43979] zookeeper.ZKUtil(162): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:08,634 DEBUG [RS:0;jenkins-hbase4:44365] zookeeper.ZKUtil(162): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:08,634 DEBUG [RS:1;jenkins-hbase4:43979] zookeeper.ZKUtil(162): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:08,634 DEBUG [RS:0;jenkins-hbase4:44365] zookeeper.ZKUtil(162): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:08,635 DEBUG [RS:1;jenkins-hbase4:43979] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:04:08,635 DEBUG [RS:0;jenkins-hbase4:44365] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:04:08,635 INFO [RS:1;jenkins-hbase4:43979] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:04:08,635 INFO [RS:0;jenkins-hbase4:44365] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:04:08,636 INFO [RS:1;jenkins-hbase4:43979] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:04:08,640 INFO [RS:1;jenkins-hbase4:43979] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:04:08,640 INFO [RS:0;jenkins-hbase4:44365] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:04:08,640 INFO [RS:1;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,641 INFO [RS:0;jenkins-hbase4:44365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:04:08,641 INFO [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:04:08,641 INFO [RS:0;jenkins-hbase4:44365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,642 INFO [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:04:08,643 INFO [RS:1;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,643 INFO [RS:0;jenkins-hbase4:44365] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,643 DEBUG [RS:1;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:1;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:0;jenkins-hbase4:44365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:1;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:0;jenkins-hbase4:44365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:1;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:0;jenkins-hbase4:44365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:1;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:0;jenkins-hbase4:44365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:1;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:04:08,644 DEBUG [RS:0;jenkins-hbase4:44365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:1;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:0;jenkins-hbase4:44365] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:04:08,644 DEBUG [RS:1;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:0;jenkins-hbase4:44365] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:1;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:0;jenkins-hbase4:44365] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:1;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:0;jenkins-hbase4:44365] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,644 DEBUG [RS:0;jenkins-hbase4:44365] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:08,646 INFO [RS:1;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,647 INFO [RS:1;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,647 INFO [RS:0;jenkins-hbase4:44365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,647 INFO [RS:1;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,647 INFO [RS:0;jenkins-hbase4:44365] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,647 INFO [RS:0;jenkins-hbase4:44365] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,658 INFO [RS:1;jenkins-hbase4:43979] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:04:08,658 INFO [RS:0;jenkins-hbase4:44365] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:04:08,658 INFO [RS:1;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43979,1676304248382-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,659 INFO [RS:0;jenkins-hbase4:44365] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44365,1676304248356-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,671 INFO [RS:0;jenkins-hbase4:44365] regionserver.Replication(203): jenkins-hbase4.apache.org,44365,1676304248356 started 2023-02-13 16:04:08,671 INFO [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,44365,1676304248356, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44365, sessionid=0x1004e6cd7990001 2023-02-13 16:04:08,671 INFO [RS:1;jenkins-hbase4:43979] regionserver.Replication(203): jenkins-hbase4.apache.org,43979,1676304248382 started 2023-02-13 16:04:08,671 DEBUG [RS:0;jenkins-hbase4:44365] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:04:08,672 INFO [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,43979,1676304248382, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43979, sessionid=0x1004e6cd7990002 2023-02-13 16:04:08,672 DEBUG [RS:0;jenkins-hbase4:44365] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:08,672 DEBUG [RS:1;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:04:08,672 DEBUG [RS:1;jenkins-hbase4:43979] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:08,672 DEBUG [RS:1;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43979,1676304248382' 2023-02-13 16:04:08,672 DEBUG [RS:1;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:08,672 DEBUG [RS:0;jenkins-hbase4:44365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44365,1676304248356' 2023-02-13 16:04:08,672 DEBUG [RS:0;jenkins-hbase4:44365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:08,672 DEBUG [RS:1;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:08,672 DEBUG [RS:0;jenkins-hbase4:44365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:08,672 DEBUG [RS:1;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:04:08,672 DEBUG [RS:1;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:04:08,672 DEBUG [RS:1;jenkins-hbase4:43979] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:08,672 DEBUG [RS:1;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43979,1676304248382' 2023-02-13 16:04:08,673 DEBUG [RS:1;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:08,672 DEBUG [RS:0;jenkins-hbase4:44365] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:04:08,673 DEBUG [RS:0;jenkins-hbase4:44365] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:04:08,673 DEBUG [RS:0;jenkins-hbase4:44365] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:08,673 DEBUG [RS:0;jenkins-hbase4:44365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44365,1676304248356' 2023-02-13 16:04:08,673 DEBUG [RS:0;jenkins-hbase4:44365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:08,673 DEBUG [RS:1;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:08,673 DEBUG [RS:0;jenkins-hbase4:44365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:08,673 DEBUG [RS:1;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:04:08,673 INFO [RS:1;jenkins-hbase4:43979] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:04:08,673 INFO [RS:1;jenkins-hbase4:43979] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:04:08,673 DEBUG [RS:0;jenkins-hbase4:44365] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:04:08,673 INFO [RS:0;jenkins-hbase4:44365] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:04:08,673 INFO [RS:0;jenkins-hbase4:44365] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:04:08,711 DEBUG [jenkins-hbase4:35089] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 16:04:08,711 DEBUG [jenkins-hbase4:35089] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:04:08,712 DEBUG [jenkins-hbase4:35089] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:04:08,712 DEBUG [jenkins-hbase4:35089] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:04:08,712 DEBUG [jenkins-hbase4:35089] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:04:08,713 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44365,1676304248356, state=OPENING 2023-02-13 16:04:08,714 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 16:04:08,715 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:08,716 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:04:08,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44365,1676304248356}] 2023-02-13 16:04:08,871 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:08,871 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:04:08,873 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39066, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:04:08,877 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 16:04:08,877 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:08,878 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44365%2C1676304248356.meta, suffix=.meta, logDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/WALs/jenkins-hbase4.apache.org,44365,1676304248356, archiveDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/oldWALs, maxLogs=32 2023-02-13 16:04:08,891 DEBUG [RS-EventLoopGroup-20-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41553,DS-b5272031-c965-4e04-955b-a16c83819a07,DISK] 2023-02-13 16:04:08,891 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39467,DS-21236228-a2c2-406d-94d7-4e43fd2885f5,DISK] 2023-02-13 16:04:08,893 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/WALs/jenkins-hbase4.apache.org,44365,1676304248356/jenkins-hbase4.apache.org%2C44365%2C1676304248356.meta.1676304248878.meta 2023-02-13 16:04:08,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39467,DS-21236228-a2c2-406d-94d7-4e43fd2885f5,DISK], DatanodeInfoWithStorage[127.0.0.1:41553,DS-b5272031-c965-4e04-955b-a16c83819a07,DISK]] 2023-02-13 16:04:08,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:08,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 16:04:08,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 16:04:08,894 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 16:04:08,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 16:04:08,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:08,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 16:04:08,894 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 16:04:08,895 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:04:08,896 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/info 2023-02-13 16:04:08,896 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/info 2023-02-13 16:04:08,896 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:04:08,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:08,896 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:04:08,897 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:04:08,897 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:04:08,897 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:04:08,898 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:08,898 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:04:08,898 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/table 2023-02-13 16:04:08,898 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/table 2023-02-13 16:04:08,899 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:04:08,899 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:08,900 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740 2023-02-13 16:04:08,900 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740 2023-02-13 16:04:08,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:04:08,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:04:08,903 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73169639, jitterRate=0.09031258523464203}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:04:08,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676304248894Writing region info on filesystem at 1676304248894Initializing all the Stores at 1676304248895 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304248895Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304248895Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304248895Cleaning up temporary data from old regions at 1676304248901 (+6 ms)Cleaning up detritus from prior splits at 1676304248901Running coprocessor post-open hooks at 1676304248903 (+2 ms)Region opened successfully at 1676304248903 2023-02-13 16:04:08,904 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676304248871 2023-02-13 16:04:08,907 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 16:04:08,908 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 16:04:08,908 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44365,1676304248356, state=OPEN 2023-02-13 16:04:08,910 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 16:04:08,910 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:04:08,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 16:04:08,911 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44365,1676304248356 in 194 msec 2023-02-13 16:04:08,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 16:04:08,912 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 353 msec 2023-02-13 16:04:08,913 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 392 msec 2023-02-13 16:04:08,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676304248402, completionTime=-1 2023-02-13 16:04:08,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 16:04:08,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 16:04:08,916 DEBUG [hconnection-0xfd2f303-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:08,917 INFO [RS-EventLoopGroup-19-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:08,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 16:04:08,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676304308919 2023-02-13 16:04:08,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676304368919 2023-02-13 16:04:08,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 5 msec 2023-02-13 16:04:08,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35089,1676304248301-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35089,1676304248301-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35089,1676304248301-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35089, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:08,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 16:04:08,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:08,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 16:04:08,930 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 16:04:08,930 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:04:08,931 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:04:08,932 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:08,932 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083 empty. 2023-02-13 16:04:08,933 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:08,933 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 16:04:08,941 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:08,942 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7a65419085b509fb80f0f37fd0e97083, NAME => 'hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp 2023-02-13 16:04:08,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:08,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 7a65419085b509fb80f0f37fd0e97083, disabling compactions & flushes 2023-02-13 16:04:08,949 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:08,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:08,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. after waiting 0 ms 2023-02-13 16:04:08,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:08,949 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:08,949 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 7a65419085b509fb80f0f37fd0e97083: Waiting for close lock at 1676304248949Disabling compacts and flushes for region at 1676304248949Disabling writes for close at 1676304248949Writing region close event to WAL at 1676304248949Closed at 1676304248949 2023-02-13 16:04:08,951 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:04:08,952 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304248952"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304248952"}]},"ts":"1676304248952"} 2023-02-13 16:04:08,953 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:04:08,954 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:04:08,954 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304248954"}]},"ts":"1676304248954"} 2023-02-13 16:04:08,955 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 16:04:08,957 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:04:08,958 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:04:08,958 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:04:08,958 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:04:08,958 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7a65419085b509fb80f0f37fd0e97083, ASSIGN}] 2023-02-13 16:04:08,961 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7a65419085b509fb80f0f37fd0e97083, ASSIGN 2023-02-13 16:04:08,962 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7a65419085b509fb80f0f37fd0e97083, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43979,1676304248382; forceNewPlan=false, retain=false 2023-02-13 16:04:09,112 INFO [jenkins-hbase4:35089] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:04:09,112 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7a65419085b509fb80f0f37fd0e97083, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:09,112 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304249112"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304249112"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304249112"}]},"ts":"1676304249112"} 2023-02-13 16:04:09,114 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7a65419085b509fb80f0f37fd0e97083, server=jenkins-hbase4.apache.org,43979,1676304248382}] 2023-02-13 16:04:09,267 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:09,267 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:04:09,269 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36178, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:04:09,273 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:09,274 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43979%2C1676304248382, suffix=, logDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/WALs/jenkins-hbase4.apache.org,43979,1676304248382, archiveDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/oldWALs, maxLogs=32 2023-02-13 16:04:09,288 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41553,DS-b5272031-c965-4e04-955b-a16c83819a07,DISK] 2023-02-13 16:04:09,289 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39467,DS-21236228-a2c2-406d-94d7-4e43fd2885f5,DISK] 2023-02-13 16:04:09,290 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/WALs/jenkins-hbase4.apache.org,43979,1676304248382/jenkins-hbase4.apache.org%2C43979%2C1676304248382.1676304249274 2023-02-13 16:04:09,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41553,DS-b5272031-c965-4e04-955b-a16c83819a07,DISK], DatanodeInfoWithStorage[127.0.0.1:39467,DS-21236228-a2c2-406d-94d7-4e43fd2885f5,DISK]] 2023-02-13 16:04:09,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7a65419085b509fb80f0f37fd0e97083, NAME => 'hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:09,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:09,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:09,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:09,291 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:09,292 INFO [StoreOpener-7a65419085b509fb80f0f37fd0e97083-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:09,293 DEBUG [StoreOpener-7a65419085b509fb80f0f37fd0e97083-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083/info 2023-02-13 16:04:09,293 DEBUG [StoreOpener-7a65419085b509fb80f0f37fd0e97083-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083/info 2023-02-13 16:04:09,294 INFO [StoreOpener-7a65419085b509fb80f0f37fd0e97083-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a65419085b509fb80f0f37fd0e97083 columnFamilyName info 2023-02-13 16:04:09,294 INFO [StoreOpener-7a65419085b509fb80f0f37fd0e97083-1] regionserver.HStore(310): Store=7a65419085b509fb80f0f37fd0e97083/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:09,295 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:09,295 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:09,297 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:09,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:09,299 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 7a65419085b509fb80f0f37fd0e97083; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68862323, jitterRate=0.026128575205802917}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:04:09,299 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 7a65419085b509fb80f0f37fd0e97083: Running coprocessor pre-open hook at 1676304249291Writing region info on filesystem at 1676304249291Initializing all the Stores at 1676304249292 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304249292Cleaning up temporary data from old regions at 1676304249295 (+3 ms)Cleaning up detritus from prior splits at 1676304249296 (+1 ms)Running coprocessor post-open hooks at 1676304249299 (+3 ms)Region opened successfully at 1676304249299 2023-02-13 16:04:09,300 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083., pid=6, masterSystemTime=1676304249267 2023-02-13 16:04:09,308 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:09,309 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:09,309 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7a65419085b509fb80f0f37fd0e97083, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:09,309 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304249309"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304249309"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304249309"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304249309"}]},"ts":"1676304249309"} 2023-02-13 16:04:09,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 16:04:09,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7a65419085b509fb80f0f37fd0e97083, server=jenkins-hbase4.apache.org,43979,1676304248382 in 196 msec 2023-02-13 16:04:09,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 16:04:09,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7a65419085b509fb80f0f37fd0e97083, ASSIGN in 354 msec 2023-02-13 16:04:09,314 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:04:09,314 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304249314"}]},"ts":"1676304249314"} 2023-02-13 16:04:09,315 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 16:04:09,323 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:04:09,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 395 msec 2023-02-13 16:04:09,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 16:04:09,331 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:04:09,331 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:09,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:09,334 INFO [RS-EventLoopGroup-20-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36182, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:09,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 16:04:09,342 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:04:09,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 9 msec 2023-02-13 16:04:09,347 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 16:04:09,355 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:04:09,357 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-13 16:04:09,360 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 16:04:09,363 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 16:04:09,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 0.954sec 2023-02-13 16:04:09,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 16:04:09,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 16:04:09,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 16:04:09,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35089,1676304248301-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 16:04:09,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35089,1676304248301-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 16:04:09,365 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 16:04:09,402 DEBUG [Listener at localhost/40929] zookeeper.ReadOnlyZKClient(139): Connect 0x0a7ed945 to 127.0.0.1:64776 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:09,405 DEBUG [Listener at localhost/40929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57c8027a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:09,407 DEBUG [hconnection-0x7fb6dda8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:09,409 INFO [RS-EventLoopGroup-19-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:09,410 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35089,1676304248301 2023-02-13 16:04:09,410 DEBUG [Listener at localhost/40929] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 16:04:09,412 DEBUG [Listener at localhost/40929] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 16:04:09,414 INFO [RS-EventLoopGroup-18-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56310, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 16:04:09,415 INFO [Listener at localhost/40929] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:09,415 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:09,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 16:04:09,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 103 connection: 172.31.14.131:56310 deadline: 1676304309415, exception=org.apache.hadoop.hbase.TableNotFoundException: testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:09,416 INFO [Listener at localhost/40929] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 16:04:09,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:09,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:09,420 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:04:09,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testRestoreSnapshotDoesNotCreateBackRefLinks" procId is: 10 2023-02-13 16:04:09,421 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:04:09,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:09,423 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:09,423 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef empty. 2023-02-13 16:04:09,424 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:09,424 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-13 16:04:09,432 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:09,433 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(7671): creating {ENCODED => 45a0cdc92def60ca6a72d8f8c8d785ef, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp 2023-02-13 16:04:09,439 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:09,440 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1603): Closing 45a0cdc92def60ca6a72d8f8c8d785ef, disabling compactions & flushes 2023-02-13 16:04:09,440 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:09,440 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:09,440 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. after waiting 0 ms 2023-02-13 16:04:09,440 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:09,440 INFO [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:09,440 DEBUG [RegionOpenAndInit-testRestoreSnapshotDoesNotCreateBackRefLinks-pool-0] regionserver.HRegion(1557): Region close journal for 45a0cdc92def60ca6a72d8f8c8d785ef: Waiting for close lock at 1676304249440Disabling compacts and flushes for region at 1676304249440Disabling writes for close at 1676304249440Writing region close event to WAL at 1676304249440Closed at 1676304249440 2023-02-13 16:04:09,442 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:04:09,443 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676304249443"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304249443"}]},"ts":"1676304249443"} 2023-02-13 16:04:09,444 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:04:09,445 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:04:09,445 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304249445"}]},"ts":"1676304249445"} 2023-02-13 16:04:09,446 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLING in hbase:meta 2023-02-13 16:04:09,449 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:04:09,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:04:09,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:04:09,450 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:04:09,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=45a0cdc92def60ca6a72d8f8c8d785ef, ASSIGN}] 2023-02-13 16:04:09,452 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=45a0cdc92def60ca6a72d8f8c8d785ef, ASSIGN 2023-02-13 16:04:09,453 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=45a0cdc92def60ca6a72d8f8c8d785ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44365,1676304248356; forceNewPlan=false, retain=false 2023-02-13 16:04:09,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:09,603 INFO [jenkins-hbase4:35089] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:04:09,604 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=45a0cdc92def60ca6a72d8f8c8d785ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:09,604 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676304249604"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304249604"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304249604"}]},"ts":"1676304249604"} 2023-02-13 16:04:09,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure 45a0cdc92def60ca6a72d8f8c8d785ef, server=jenkins-hbase4.apache.org,44365,1676304248356}] 2023-02-13 16:04:09,675 INFO [RS:0;jenkins-hbase4:44365] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44365%2C1676304248356, suffix=, logDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/WALs/jenkins-hbase4.apache.org,44365,1676304248356, archiveDir=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/oldWALs, maxLogs=32 2023-02-13 16:04:09,688 DEBUG [RS-EventLoopGroup-20-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41553,DS-b5272031-c965-4e04-955b-a16c83819a07,DISK] 2023-02-13 16:04:09,688 DEBUG [RS-EventLoopGroup-20-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39467,DS-21236228-a2c2-406d-94d7-4e43fd2885f5,DISK] 2023-02-13 16:04:09,690 INFO [RS:0;jenkins-hbase4:44365] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/WALs/jenkins-hbase4.apache.org,44365,1676304248356/jenkins-hbase4.apache.org%2C44365%2C1676304248356.1676304249675 2023-02-13 16:04:09,690 DEBUG [RS:0;jenkins-hbase4:44365] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41553,DS-b5272031-c965-4e04-955b-a16c83819a07,DISK], DatanodeInfoWithStorage[127.0.0.1:39467,DS-21236228-a2c2-406d-94d7-4e43fd2885f5,DISK]] 2023-02-13 16:04:09,707 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 16:04:09,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:09,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:09,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 45a0cdc92def60ca6a72d8f8c8d785ef, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:09,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testRestoreSnapshotDoesNotCreateBackRefLinks 45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:09,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:09,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:09,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:09,767 INFO [StoreOpener-45a0cdc92def60ca6a72d8f8c8d785ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:09,769 DEBUG [StoreOpener-45a0cdc92def60ca6a72d8f8c8d785ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1 2023-02-13 16:04:09,769 DEBUG [StoreOpener-45a0cdc92def60ca6a72d8f8c8d785ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1 2023-02-13 16:04:09,770 INFO [StoreOpener-45a0cdc92def60ca6a72d8f8c8d785ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45a0cdc92def60ca6a72d8f8c8d785ef columnFamilyName f1 2023-02-13 16:04:09,770 INFO [StoreOpener-45a0cdc92def60ca6a72d8f8c8d785ef-1] regionserver.HStore(310): Store=45a0cdc92def60ca6a72d8f8c8d785ef/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:09,770 INFO [StoreOpener-45a0cdc92def60ca6a72d8f8c8d785ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region 45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:09,772 DEBUG [StoreOpener-45a0cdc92def60ca6a72d8f8c8d785ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2 2023-02-13 16:04:09,772 DEBUG [StoreOpener-45a0cdc92def60ca6a72d8f8c8d785ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2 2023-02-13 16:04:09,772 INFO [StoreOpener-45a0cdc92def60ca6a72d8f8c8d785ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45a0cdc92def60ca6a72d8f8c8d785ef columnFamilyName f2 2023-02-13 16:04:09,772 INFO [StoreOpener-45a0cdc92def60ca6a72d8f8c8d785ef-1] regionserver.HStore(310): Store=45a0cdc92def60ca6a72d8f8c8d785ef/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:09,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:09,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:09,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testRestoreSnapshotDoesNotCreateBackRefLinks descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:09,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:09,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:09,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 45a0cdc92def60ca6a72d8f8c8d785ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72882860, jitterRate=0.08603924512863159}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:09,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 45a0cdc92def60ca6a72d8f8c8d785ef: Running coprocessor pre-open hook at 1676304249765Writing region info on filesystem at 1676304249765Initializing all the Stores at 1676304249766 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304249766Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304249766Cleaning up temporary data from old regions at 1676304249775 (+9 ms)Cleaning up detritus from prior splits at 1676304249776 (+1 ms)Running coprocessor post-open hooks at 1676304249779 (+3 ms)Region opened successfully at 1676304249779 2023-02-13 16:04:09,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef., pid=12, masterSystemTime=1676304249758 2023-02-13 16:04:09,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:09,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:09,783 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=45a0cdc92def60ca6a72d8f8c8d785ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:09,783 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676304249783"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304249783"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304249783"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304249783"}]},"ts":"1676304249783"} 2023-02-13 16:04:09,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 16:04:09,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure 45a0cdc92def60ca6a72d8f8c8d785ef, server=jenkins-hbase4.apache.org,44365,1676304248356 in 179 msec 2023-02-13 16:04:09,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 16:04:09,787 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=45a0cdc92def60ca6a72d8f8c8d785ef, ASSIGN in 335 msec 2023-02-13 16:04:09,788 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:04:09,788 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304249788"}]},"ts":"1676304249788"} 2023-02-13 16:04:09,789 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=ENABLED in hbase:meta 2023-02-13 16:04:09,791 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:04:09,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 373 msec 2023-02-13 16:04:10,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:10,029 INFO [Listener at localhost/40929] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 10 completed 2023-02-13 16:04:10,029 DEBUG [Listener at localhost/40929] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testRestoreSnapshotDoesNotCreateBackRefLinks get assigned. Timeout = 60000ms 2023-02-13 16:04:10,029 INFO [Listener at localhost/40929] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:04:10,031 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(3484): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned to meta. Checking AM states. 2023-02-13 16:04:10,031 INFO [Listener at localhost/40929] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:04:10,032 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(3504): All regions for table testRestoreSnapshotDoesNotCreateBackRefLinks assigned. 2023-02-13 16:04:10,032 INFO [Listener at localhost/40929] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 16:04:10,065 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44365] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:10,160 INFO [Listener at localhost/40929] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 16:04:10,160 INFO [Listener at localhost/40929] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 16:04:10,163 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 16:04:10,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676304250163 (current time:1676304250163). 2023-02-13 16:04:10,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 16:04:10,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] zookeeper.ReadOnlyZKClient(139): Connect 0x72bf38b5 to 127.0.0.1:64776 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:10,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@558892c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:10,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:10,169 INFO [RS-EventLoopGroup-19-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39092, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:10,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72bf38b5 to 127.0.0.1:64776 2023-02-13 16:04:10,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:10,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 16:04:10,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 16:04:10,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 16:04:10,173 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 16:04:10,174 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE; timeout=600000, timestamp=1676304850174 2023-02-13 16:04:10,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] snapshot.SnapshotManager(653): Started snapshot: { ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } 2023-02-13 16:04:10,174 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,175 DEBUG [Listener at localhost/40929] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 16:04:10,176 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE 2023-02-13 16:04:10,176 DEBUG [Listener at localhost/40929] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 16:04:10,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 16:04:10,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=EXCLUSIVE in 5 msec 2023-02-13 16:04:10,178 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 16:04:10,179 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED; timeout=600000, timestamp=1676304850179 2023-02-13 16:04:10,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure foo 2023-02-13 16:04:10,187 INFO [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'foo' 2023-02-13 16:04:10,187 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:04:10,187 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'foo' starting 'acquire' 2023-02-13 16:04:10,187 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'foo', kicking off acquire phase on members. 2023-02-13 16:04:10,188 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,188 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/foo 2023-02-13 16:04:10,190 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:10,190 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:10,190 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:10,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:10,191 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 16:04:10,191 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:04:10,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/foo 2023-02-13 16:04:10,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 16:04:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 16:04:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-13 16:04:10,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/foo 2023-02-13 16:04:10,192 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-13 16:04:10,192 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot foo from table testRestoreSnapshotDoesNotCreateBackRefLinks type FLUSH 2023-02-13 16:04:10,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 16:04:10,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:foo 2023-02-13 16:04:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 16:04:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:04:10,192 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'foo' with timeout 300000ms 2023-02-13 16:04:10,193 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 16:04:10,193 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 16:04:10,193 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:04:10,193 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44365,1676304248356' joining acquired barrier for procedure (foo) in zk 2023-02-13 16:04:10,194 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'foo' starting 'acquire' stage 2023-02-13 16:04:10,194 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'foo' locally acquired 2023-02-13 16:04:10,194 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1676304248382' joining acquired barrier for procedure (foo) in zk 2023-02-13 16:04:10,195 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,195 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:04:10,195 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,195 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,195 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:10,196 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,196 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'foo' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:04:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:10,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44365,1676304248356' joining acquired barrier for procedure 'foo' on coordinator 2023-02-13 16:04:10,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35b5e7d4[Count = 0] remaining members to acquire global barrier 2023-02-13 16:04:10,198 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'foo' starting 'in-barrier' execution. 2023-02-13 16:04:10,198 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,199 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,199 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,199 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 16:04:10,199 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'foo' received 'reached' from coordinator. 2023-02-13 16:04:10,199 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 16:04:10,199 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,43979,1676304248382' in zk 2023-02-13 16:04:10,199 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 16:04:10,200 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 16:04:10,199 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,200 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:04:10,200 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:10,200 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. started... 2023-02-13 16:04:10,200 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] regionserver.HRegion(2744): Flushing 45a0cdc92def60ca6a72d8f8c8d785ef 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 16:04:10,201 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 16:04:10,201 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:10,201 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 16:04:10,215 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/.tmp/f1/a4120a7218344250907c71c700d4a788 2023-02-13 16:04:10,238 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/.tmp/f2/e377b03fdae34fa397e1971c9612b080 2023-02-13 16:04:10,242 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/.tmp/f1/a4120a7218344250907c71c700d4a788 as hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/a4120a7218344250907c71c700d4a788 2023-02-13 16:04:10,248 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/a4120a7218344250907c71c700d4a788, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 16:04:10,249 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/.tmp/f2/e377b03fdae34fa397e1971c9612b080 as hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/e377b03fdae34fa397e1971c9612b080 2023-02-13 16:04:10,256 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/e377b03fdae34fa397e1971c9612b080, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 16:04:10,257 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for 45a0cdc92def60ca6a72d8f8c8d785ef in 57ms, sequenceid=5, compaction requested=false 2023-02-13 16:04:10,257 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 16:04:10,258 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 45a0cdc92def60ca6a72d8f8c8d785ef: 2023-02-13 16:04:10,258 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.' region-info for snapshot=foo 2023-02-13 16:04:10,258 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:04:10,258 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/a4120a7218344250907c71c700d4a788] hfiles 2023-02-13 16:04:10,258 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/a4120a7218344250907c71c700d4a788 for snapshot=foo 2023-02-13 16:04:10,258 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/e377b03fdae34fa397e1971c9612b080] hfiles 2023-02-13 16:04:10,258 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/e377b03fdae34fa397e1971c9612b080 for snapshot=foo 2023-02-13 16:04:10,275 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. completed. 2023-02-13 16:04:10,276 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:10,276 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 16:04:10,276 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 16:04:10,276 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,276 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'foo' locally completed 2023-02-13 16:04:10,276 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'foo' completed for member 'jenkins-hbase4.apache.org,44365,1676304248356' in zk 2023-02-13 16:04:10,276 DEBUG [Listener at localhost/40929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:04:10,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 16:04:10,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] snapshot.SnapshotManager(404): Snapshoting '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:04:10,278 DEBUG [Listener at localhost/40929] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 16:04:10,278 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,278 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'foo' has notified controller of completion 2023-02-13 16:04:10,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:04:10,278 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:10,279 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'foo' completed. 2023-02-13 16:04:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:10,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:10,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:04:10,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:10,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:04:10,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'foo' member 'jenkins-hbase4.apache.org,44365,1676304248356': 2023-02-13 16:04:10,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44365,1676304248356' released barrier for procedure'foo', counting down latch. Waiting for 0 more 2023-02-13 16:04:10,282 INFO [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'foo' execution completed 2023-02-13 16:04:10,282 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:04:10,282 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:04:10,282 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:foo 2023-02-13 16:04:10,282 INFO [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure fooincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 16:04:10,284 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,284 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,284 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:10,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,284 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:10,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:04:10,284 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:10,284 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:10,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:10,285 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:04:10,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:10,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:04:10,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,286 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,287 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:10,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----foo 2023-02-13 16:04:10,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,291 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,291 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 16:04:10,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:10,292 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:10,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:10,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:10,292 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for foo 2023-02-13 16:04:10,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for foo 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/foo 2023-02-13 16:04:10,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:10,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:10,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/foo 2023-02-13 16:04:10,292 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/foo 2023-02-13 16:04:10,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.hbase-snapshot/.tmp/foo 2023-02-13 16:04:10,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.hbase-snapshot/.tmp/foo to hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.hbase-snapshot/foo 2023-02-13 16:04:10,330 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed 2023-02-13 16:04:10,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.hbase-snapshot/.tmp/foo 2023-02-13 16:04:10,331 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.hbase-snapshot/.tmp/foo 2023-02-13 16:04:10,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot foo C_M_SNAPSHOT_TABLE on table testRestoreSnapshotDoesNotCreateBackRefLinks at 1676304250174Consolidate snapshot: foo at 1676304250292 (+118 ms)Loading Region manifests for foo at 1676304250292Writing data manifest for foo at 1676304250295 (+3 ms)Verifying snapshot: foo at 1676304250306 (+11 ms)Snapshot foo of table testRestoreSnapshotDoesNotCreateBackRefLinks completed at 1676304250330 (+24 ms) 2023-02-13 16:04:10,333 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED 2023-02-13 16:04:10,335 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, type=SHARED in 158 msec 2023-02-13 16:04:10,478 DEBUG [Listener at localhost/40929] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:04:10,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 } is done 2023-02-13 16:04:10,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] snapshot.SnapshotManager(401): Snapshot '{ ss=foo table=testRestoreSnapshotDoesNotCreateBackRefLinks type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 16:04:10,480 INFO [Listener at localhost/40929] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 16:04:10,484 INFO [Listener at localhost/40929] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 16:04:10,488 INFO [Listener at localhost/40929] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 16:04:10,531 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44365] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:10,623 INFO [Listener at localhost/40929] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 16:04:10,628 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 16:04:10,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] procedure.ProcedureCoordinator(165): Submitting procedure testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,630 INFO [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 16:04:10,630 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:04:10,632 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' 2023-02-13 16:04:10,632 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks', kicking off acquire phase on members. 2023-02-13 16:04:10,632 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,632 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,635 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:10,635 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:10,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:10,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:10,635 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:10,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:10,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,636 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,636 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:04:10,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:04:10,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,636 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:04:10,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,636 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,636 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,636 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,636 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-13 16:04:10,637 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:04:10,638 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-13 16:04:10,638 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' with timeout 60000ms 2023-02-13 16:04:10,638 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 16:04:10,638 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:04:10,638 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:10,639 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'acquire' stage 2023-02-13 16:04:10,639 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-13 16:04:10,638 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 16:04:10,639 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1676304248382' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-13 16:04:10,639 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. started... 2023-02-13 16:04:10,639 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 45a0cdc92def60ca6a72d8f8c8d785ef 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 16:04:10,641 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,641 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,641 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:10,660 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/.tmp/f1/c99f328ed69642b6a20d4c4e5933344f 2023-02-13 16:04:10,682 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/.tmp/f2/8f4e167657e446058a1a6e04284ca18c 2023-02-13 16:04:10,687 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/.tmp/f1/c99f328ed69642b6a20d4c4e5933344f as hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/c99f328ed69642b6a20d4c4e5933344f 2023-02-13 16:04:10,691 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/c99f328ed69642b6a20d4c4e5933344f, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 16:04:10,692 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/.tmp/f2/8f4e167657e446058a1a6e04284ca18c as hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/8f4e167657e446058a1a6e04284ca18c 2023-02-13 16:04:10,696 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/8f4e167657e446058a1a6e04284ca18c, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 16:04:10,699 INFO [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for 45a0cdc92def60ca6a72d8f8c8d785ef in 60ms, sequenceid=9, compaction requested=false 2023-02-13 16:04:10,700 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 45a0cdc92def60ca6a72d8f8c8d785ef: 2023-02-13 16:04:10,700 DEBUG [rs(jenkins-hbase4.apache.org,44365,1676304248356)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 16:04:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 16:04:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally acquired 2023-02-13 16:04:10,700 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,44365,1676304248356' joining acquired barrier for procedure (testRestoreSnapshotDoesNotCreateBackRefLinks) in zk 2023-02-13 16:04:10,702 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,702 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:10,702 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,702 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:10,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,44365,1676304248356' joining acquired barrier for procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' on coordinator 2023-02-13 16:04:10,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@318a75ba[Count = 0] remaining members to acquire global barrier 2023-02-13 16:04:10,708 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' starting 'in-barrier' execution. 2023-02-13 16:04:10,708 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,709 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,709 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,709 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-13 16:04:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-13 16:04:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,43979,1676304248382' in zk 2023-02-13 16:04:10,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,710 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:04:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' received 'reached' from coordinator. 2023-02-13 16:04:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' locally completed 2023-02-13 16:04:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed for member 'jenkins-hbase4.apache.org,44365,1676304248356' in zk 2023-02-13 16:04:10,712 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-13 16:04:10,713 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:10,713 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1676304248382' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-13 16:04:10,713 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,713 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' has notified controller of completion 2023-02-13 16:04:10,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:10,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:10,713 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:10,714 DEBUG [member: 'jenkins-hbase4.apache.org,44365,1676304248356' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' completed. 2023-02-13 16:04:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:10,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' member 'jenkins-hbase4.apache.org,44365,1676304248356': 2023-02-13 16:04:10,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,44365,1676304248356' released barrier for procedure'testRestoreSnapshotDoesNotCreateBackRefLinks', counting down latch. Waiting for 0 more 2023-02-13 16:04:10,717 INFO [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testRestoreSnapshotDoesNotCreateBackRefLinks' execution completed 2023-02-13 16:04:10,717 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:04:10,717 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:04:10,717 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,717 INFO [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testRestoreSnapshotDoesNotCreateBackRefLinksincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 16:04:10,718 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,718 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,718 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:10,718 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:10,718 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:10,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,719 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:10,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:10,719 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:10,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,721 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,721 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:10,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,723 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,723 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:10,723 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,723 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,723 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:10,723 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,723 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:10,724 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testRestoreSnapshotDoesNotCreateBackRefLinks' 2023-02-13 16:04:10,724 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 16:04:10,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:10,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:10,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:10,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:10,724 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:10,724 DEBUG [Listener at localhost/40929] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testRestoreSnapshotDoesNotCreateBackRefLinks'' to complete. (max 20000 ms per retry) 2023-02-13 16:04:10,724 DEBUG [(jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:10,724 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,724 DEBUG [Listener at localhost/40929] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 16:04:10,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:10,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:10,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:10,724 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:10,724 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:10,725 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,725 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,824 DEBUG [Listener at localhost/40929] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 16:04:10,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 16:04:10,830 INFO [Listener at localhost/40929] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676304250163 type: FLUSH version: 2 ttl: 0 2023-02-13 16:04:10,830 DEBUG [Listener at localhost/40929] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45685/user/jenkins/test-data/f3c47139-31c6-40e8-26c7-896f31a93614/foo/5c1efe78-88c4-4bb3-a08b-9569eb864c7d/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,831 INFO [Listener at localhost/40929] snapshot.RestoreSnapshotHelper(239): region to add: 45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:10,831 INFO [Listener at localhost/40929] snapshot.RestoreSnapshotHelper(585): clone region=45a0cdc92def60ca6a72d8f8c8d785ef as 45a0cdc92def60ca6a72d8f8c8d785ef in snapshot foo 2023-02-13 16:04:10,832 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => 45a0cdc92def60ca6a72d8f8c8d785ef, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testRestoreSnapshotDoesNotCreateBackRefLinks', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45685/user/jenkins/test-data/f3c47139-31c6-40e8-26c7-896f31a93614/foo/5c1efe78-88c4-4bb3-a08b-9569eb864c7d 2023-02-13 16:04:10,846 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:10,846 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink a4120a7218344250907c71c700d4a788 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,849 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink e377b03fdae34fa397e1971c9612b080 from cloned region in snapshot foo to table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,851 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing 45a0cdc92def60ca6a72d8f8c8d785ef, disabling compactions & flushes 2023-02-13 16:04:10,851 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:10,851 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:10,851 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. after waiting 0 ms 2023-02-13 16:04:10,851 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:10,851 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:10,851 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for 45a0cdc92def60ca6a72d8f8c8d785ef: Waiting for close lock at 1676304250851Disabling compacts and flushes for region at 1676304250851Disabling writes for close at 1676304250851Writing region close event to WAL at 1676304250851Closed at 1676304250851 2023-02-13 16:04:10,854 INFO [Listener at localhost/40929] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "foo" table: "testRestoreSnapshotDoesNotCreateBackRefLinks" creation_time: 1676304250163 type: FLUSH version: 2 ttl: 0 2023-02-13 16:04:10,854 DEBUG [Listener at localhost/40929] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:45685/user/jenkins/test-data/f3c47139-31c6-40e8-26c7-896f31a93614/foo/5c1efe78-88c4-4bb3-a08b-9569eb864c7d 2023-02-13 16:04:10,854 DEBUG [Listener at localhost/40929] util.CommonFSUtils(682): File system contents for path hdfs://localhost:45685/user/jenkins/test-data/f3c47139-31c6-40e8-26c7-896f31a93614/foo/5c1efe78-88c4-4bb3-a08b-9569eb864c7d 2023-02-13 16:04:10,855 DEBUG [Listener at localhost/40929] util.CommonFSUtils(699): |-data/ 2023-02-13 16:04:10,855 DEBUG [Listener at localhost/40929] util.CommonFSUtils(699): |----default/ 2023-02-13 16:04:10,856 DEBUG [Listener at localhost/40929] util.CommonFSUtils(699): |-------testRestoreSnapshotDoesNotCreateBackRefLinks/ 2023-02-13 16:04:10,856 DEBUG [Listener at localhost/40929] util.CommonFSUtils(699): |----------45a0cdc92def60ca6a72d8f8c8d785ef/ 2023-02-13 16:04:10,857 DEBUG [Listener at localhost/40929] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:10,857 DEBUG [Listener at localhost/40929] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:10,857 DEBUG [Listener at localhost/40929] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=45a0cdc92def60ca6a72d8f8c8d785ef-a4120a7218344250907c71c700d4a788 2023-02-13 16:04:10,857 DEBUG [Listener at localhost/40929] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:10,858 DEBUG [Listener at localhost/40929] util.CommonFSUtils(702): |----------------testRestoreSnapshotDoesNotCreateBackRefLinks=45a0cdc92def60ca6a72d8f8c8d785ef-e377b03fdae34fa397e1971c9612b080 hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/a4120a7218344250907c71c700d4a788 hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/c99f328ed69642b6a20d4c4e5933344f hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/8f4e167657e446058a1a6e04284ca18c hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/e377b03fdae34fa397e1971c9612b080 2023-02-13 16:04:10,866 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "foo" 2023-02-13 16:04:10,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] snapshot.SnapshotManager(333): Deleting snapshot: foo 2023-02-13 16:04:10,871 INFO [Listener at localhost/40929] client.HBaseAdmin$15(890): Started disable of testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:10,876 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304250875"}]},"ts":"1676304250875"} 2023-02-13 16:04:10,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:04:10,877 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLING in hbase:meta 2023-02-13 16:04:10,880 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLING 2023-02-13 16:04:10,880 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=45a0cdc92def60ca6a72d8f8c8d785ef, UNASSIGN}] 2023-02-13 16:04:10,882 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=45a0cdc92def60ca6a72d8f8c8d785ef, UNASSIGN 2023-02-13 16:04:10,883 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=45a0cdc92def60ca6a72d8f8c8d785ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:10,883 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676304250883"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304250883"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304250883"}]},"ts":"1676304250883"} 2023-02-13 16:04:10,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure 45a0cdc92def60ca6a72d8f8c8d785ef, server=jenkins-hbase4.apache.org,44365,1676304248356}] 2023-02-13 16:04:10,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:04:11,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close 45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:11,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 45a0cdc92def60ca6a72d8f8c8d785ef, disabling compactions & flushes 2023-02-13 16:04:11,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:11,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:11,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. after waiting 0 ms 2023-02-13 16:04:11,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:11,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:11,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef. 2023-02-13 16:04:11,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 45a0cdc92def60ca6a72d8f8c8d785ef: Waiting for close lock at 1676304251037Running coprocessor pre-close hooks at 1676304251037Disabling compacts and flushes for region at 1676304251037Disabling writes for close at 1676304251037Writing region close event to WAL at 1676304251038 (+1 ms)Running coprocessor post-close hooks at 1676304251041 (+3 ms)Closed at 1676304251042 (+1 ms) 2023-02-13 16:04:11,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed 45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:11,044 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=45a0cdc92def60ca6a72d8f8c8d785ef, regionState=CLOSED 2023-02-13 16:04:11,044 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1676304251044"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304251044"}]},"ts":"1676304251044"} 2023-02-13 16:04:11,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 16:04:11,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure 45a0cdc92def60ca6a72d8f8c8d785ef, server=jenkins-hbase4.apache.org,44365,1676304248356 in 162 msec 2023-02-13 16:04:11,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 16:04:11,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks, region=45a0cdc92def60ca6a72d8f8c8d785ef, UNASSIGN in 167 msec 2023-02-13 16:04:11,048 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304251048"}]},"ts":"1676304251048"} 2023-02-13 16:04:11,049 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testRestoreSnapshotDoesNotCreateBackRefLinks, state=DISABLED in hbase:meta 2023-02-13 16:04:11,051 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testRestoreSnapshotDoesNotCreateBackRefLinks to state=DISABLED 2023-02-13 16:04:11,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 180 msec 2023-02-13 16:04:11,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:04:11,180 INFO [Listener at localhost/40929] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 15 completed 2023-02-13 16:04:11,181 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:11,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:11,184 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:11,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 16:04:11,185 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:11,189 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:11,191 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1, FileablePath, hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2, FileablePath, hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/recovered.edits] 2023-02-13 16:04:11,194 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/a4120a7218344250907c71c700d4a788 to hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/a4120a7218344250907c71c700d4a788 2023-02-13 16:04:11,195 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/c99f328ed69642b6a20d4c4e5933344f to hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f1/c99f328ed69642b6a20d4c4e5933344f 2023-02-13 16:04:11,198 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/8f4e167657e446058a1a6e04284ca18c to hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/8f4e167657e446058a1a6e04284ca18c 2023-02-13 16:04:11,199 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/e377b03fdae34fa397e1971c9612b080 to hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/f2/e377b03fdae34fa397e1971c9612b080 2023-02-13 16:04:11,201 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/recovered.edits/12.seqid to hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/archive/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef/recovered.edits/12.seqid 2023-02-13 16:04:11,201 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/.tmp/data/default/testRestoreSnapshotDoesNotCreateBackRefLinks/45a0cdc92def60ca6a72d8f8c8d785ef 2023-02-13 16:04:11,201 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testRestoreSnapshotDoesNotCreateBackRefLinks regions 2023-02-13 16:04:11,203 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:11,205 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testRestoreSnapshotDoesNotCreateBackRefLinks from hbase:meta 2023-02-13 16:04:11,206 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' descriptor. 2023-02-13 16:04:11,211 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:11,211 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testRestoreSnapshotDoesNotCreateBackRefLinks' from region states. 2023-02-13 16:04:11,211 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304251211"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:11,212 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 16:04:11,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 45a0cdc92def60ca6a72d8f8c8d785ef, NAME => 'testRestoreSnapshotDoesNotCreateBackRefLinks,,1676304249418.45a0cdc92def60ca6a72d8f8c8d785ef.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 16:04:11,212 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testRestoreSnapshotDoesNotCreateBackRefLinks' as deleted. 2023-02-13 16:04:11,212 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testRestoreSnapshotDoesNotCreateBackRefLinks","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676304251212"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:11,213 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testRestoreSnapshotDoesNotCreateBackRefLinks state from META 2023-02-13 16:04:11,215 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks 2023-02-13 16:04:11,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testRestoreSnapshotDoesNotCreateBackRefLinks in 34 msec 2023-02-13 16:04:11,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35089] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 16:04:11,286 INFO [Listener at localhost/40929] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testRestoreSnapshotDoesNotCreateBackRefLinks, procId: 18 completed 2023-02-13 16:04:11,287 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 16:04:11,287 INFO [Listener at localhost/40929] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 16:04:11,287 DEBUG [Listener at localhost/40929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a7ed945 to 127.0.0.1:64776 2023-02-13 16:04:11,287 DEBUG [Listener at localhost/40929] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:11,287 DEBUG [Listener at localhost/40929] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 16:04:11,287 DEBUG [Listener at localhost/40929] util.JVMClusterUtil(257): Found active master hash=1102827111, stopped=false 2023-02-13 16:04:11,287 INFO [Listener at localhost/40929] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35089,1676304248301 2023-02-13 16:04:11,291 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:11,291 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:11,291 INFO [Listener at localhost/40929] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 16:04:11,291 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:11,291 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:11,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:11,292 DEBUG [Listener at localhost/40929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1583a075 to 127.0.0.1:64776 2023-02-13 16:04:11,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:11,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:11,293 DEBUG [Listener at localhost/40929] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:11,293 INFO [Listener at localhost/40929] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,44365,1676304248356' ***** 2023-02-13 16:04:11,293 INFO [Listener at localhost/40929] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:04:11,293 INFO [Listener at localhost/40929] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,43979,1676304248382' ***** 2023-02-13 16:04:11,293 INFO [Listener at localhost/40929] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:04:11,293 INFO [RS:0;jenkins-hbase4:44365] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:04:11,293 INFO [RS:0;jenkins-hbase4:44365] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:04:11,293 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:04:11,293 INFO [RS:0;jenkins-hbase4:44365] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:04:11,294 INFO [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:11,294 INFO [RS:1;jenkins-hbase4:43979] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:04:11,294 INFO [RS:1;jenkins-hbase4:43979] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:04:11,294 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:04:11,294 DEBUG [RS:0;jenkins-hbase4:44365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x367fb85f to 127.0.0.1:64776 2023-02-13 16:04:11,294 INFO [RS:1;jenkins-hbase4:43979] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:04:11,295 DEBUG [RS:0;jenkins-hbase4:44365] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:11,295 INFO [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(3304): Received CLOSE for 7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:11,295 INFO [RS:0;jenkins-hbase4:44365] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:04:11,296 INFO [RS:0;jenkins-hbase4:44365] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:04:11,296 INFO [RS:0;jenkins-hbase4:44365] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:04:11,296 INFO [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 16:04:11,296 INFO [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:11,296 DEBUG [RS:1;jenkins-hbase4:43979] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38c6567f to 127.0.0.1:64776 2023-02-13 16:04:11,296 DEBUG [RS:1;jenkins-hbase4:43979] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:11,296 INFO [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 16:04:11,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 7a65419085b509fb80f0f37fd0e97083, disabling compactions & flushes 2023-02-13 16:04:11,296 DEBUG [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1479): Online Regions={7a65419085b509fb80f0f37fd0e97083=hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083.} 2023-02-13 16:04:11,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:11,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:11,296 DEBUG [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1505): Waiting on 7a65419085b509fb80f0f37fd0e97083 2023-02-13 16:04:11,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. after waiting 0 ms 2023-02-13 16:04:11,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:11,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 7a65419085b509fb80f0f37fd0e97083 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 16:04:11,299 INFO [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1475): Waiting on 1 regions to close 2023-02-13 16:04:11,299 DEBUG [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-02-13 16:04:11,299 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:04:11,299 DEBUG [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-13 16:04:11,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:04:11,299 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:04:11,299 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:04:11,299 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:04:11,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=4.46 KB heapSize=7.87 KB 2023-02-13 16:04:11,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083/.tmp/info/df48e7c3ada6466eb86fe1ca8622096e 2023-02-13 16:04:11,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.77 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/.tmp/info/dfcc52b1ee2c4304b7848c7ed8c04f2d 2023-02-13 16:04:11,316 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfcc52b1ee2c4304b7848c7ed8c04f2d 2023-02-13 16:04:11,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083/.tmp/info/df48e7c3ada6466eb86fe1ca8622096e as hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083/info/df48e7c3ada6466eb86fe1ca8622096e 2023-02-13 16:04:11,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083/info/df48e7c3ada6466eb86fe1ca8622096e, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 16:04:11,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7a65419085b509fb80f0f37fd0e97083 in 25ms, sequenceid=6, compaction requested=false 2023-02-13 16:04:11,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/namespace/7a65419085b509fb80f0f37fd0e97083/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 16:04:11,327 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=124 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/.tmp/rep_barrier/12b901fdf4ee4ac0b646b9e7d9a08cb7 2023-02-13 16:04:11,328 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:11,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 7a65419085b509fb80f0f37fd0e97083: Waiting for close lock at 1676304251296Running coprocessor pre-close hooks at 1676304251296Disabling compacts and flushes for region at 1676304251296Disabling writes for close at 1676304251296Obtaining lock to block concurrent updates at 1676304251296Preparing flush snapshotting stores in 7a65419085b509fb80f0f37fd0e97083 at 1676304251296Finished memstore snapshotting hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676304251296Flushing stores of hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. at 1676304251299 (+3 ms)Flushing 7a65419085b509fb80f0f37fd0e97083/info: creating writer at 1676304251299Flushing 7a65419085b509fb80f0f37fd0e97083/info: appending metadata at 1676304251301 (+2 ms)Flushing 7a65419085b509fb80f0f37fd0e97083/info: closing flushed file at 1676304251301Flushing 7a65419085b509fb80f0f37fd0e97083/info: reopening flushed file at 1676304251317 (+16 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 7a65419085b509fb80f0f37fd0e97083 in 25ms, sequenceid=6, compaction requested=false at 1676304251321 (+4 ms)Writing region close event to WAL at 1676304251324 (+3 ms)Running coprocessor post-close hooks at 1676304251327 (+3 ms)Closed at 1676304251328 (+1 ms) 2023-02-13 16:04:11,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676304248928.7a65419085b509fb80f0f37fd0e97083. 2023-02-13 16:04:11,331 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12b901fdf4ee4ac0b646b9e7d9a08cb7 2023-02-13 16:04:11,338 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=590 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/.tmp/table/be3c65efe3544bb39cbb17c386e1c3fb 2023-02-13 16:04:11,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be3c65efe3544bb39cbb17c386e1c3fb 2023-02-13 16:04:11,342 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/.tmp/info/dfcc52b1ee2c4304b7848c7ed8c04f2d as hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/info/dfcc52b1ee2c4304b7848c7ed8c04f2d 2023-02-13 16:04:11,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dfcc52b1ee2c4304b7848c7ed8c04f2d 2023-02-13 16:04:11,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/info/dfcc52b1ee2c4304b7848c7ed8c04f2d, entries=12, sequenceid=21, filesize=6.3 K 2023-02-13 16:04:11,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/.tmp/rep_barrier/12b901fdf4ee4ac0b646b9e7d9a08cb7 as hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/rep_barrier/12b901fdf4ee4ac0b646b9e7d9a08cb7 2023-02-13 16:04:11,349 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 12b901fdf4ee4ac0b646b9e7d9a08cb7 2023-02-13 16:04:11,349 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/rep_barrier/12b901fdf4ee4ac0b646b9e7d9a08cb7, entries=1, sequenceid=21, filesize=5.1 K 2023-02-13 16:04:11,350 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:11,350 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:11,352 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/.tmp/table/be3c65efe3544bb39cbb17c386e1c3fb as hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/table/be3c65efe3544bb39cbb17c386e1c3fb 2023-02-13 16:04:11,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be3c65efe3544bb39cbb17c386e1c3fb 2023-02-13 16:04:11,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/table/be3c65efe3544bb39cbb17c386e1c3fb, entries=4, sequenceid=21, filesize=5.1 K 2023-02-13 16:04:11,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 57ms, sequenceid=21, compaction requested=false 2023-02-13 16:04:11,361 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 16:04:11,361 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 16:04:11,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:11,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304251299Running coprocessor pre-close hooks at 1676304251299Disabling compacts and flushes for region at 1676304251299Disabling writes for close at 1676304251299Obtaining lock to block concurrent updates at 1676304251299Preparing flush snapshotting stores in 1588230740 at 1676304251299Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=4572, getHeapSize=8008, getOffHeapSize=0, getCellsCount=36 at 1676304251300 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1676304251300Flushing 1588230740/info: creating writer at 1676304251300Flushing 1588230740/info: appending metadata at 1676304251302 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676304251302Flushing 1588230740/rep_barrier: creating writer at 1676304251316 (+14 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676304251318 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676304251318Flushing 1588230740/table: creating writer at 1676304251331 (+13 ms)Flushing 1588230740/table: appending metadata at 1676304251333 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676304251333Flushing 1588230740/info: reopening flushed file at 1676304251343 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676304251347 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676304251352 (+5 ms)Finished flush of dataSize ~4.46 KB/4572, heapSize ~7.82 KB/8008, currentSize=0 B/0 for 1588230740 in 57ms, sequenceid=21, compaction requested=false at 1676304251357 (+5 ms)Writing region close event to WAL at 1676304251358 (+1 ms)Running coprocessor post-close hooks at 1676304251361 (+3 ms)Closed at 1676304251362 (+1 ms) 2023-02-13 16:04:11,362 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:11,496 INFO [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,43979,1676304248382; all regions closed. 2023-02-13 16:04:11,499 INFO [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,44365,1676304248356; all regions closed. 2023-02-13 16:04:11,501 DEBUG [RS:1;jenkins-hbase4:43979] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/oldWALs 2023-02-13 16:04:11,501 INFO [RS:1;jenkins-hbase4:43979] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43979%2C1676304248382:(num 1676304249274) 2023-02-13 16:04:11,501 DEBUG [RS:1;jenkins-hbase4:43979] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:11,501 INFO [RS:1;jenkins-hbase4:43979] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:11,501 INFO [RS:1;jenkins-hbase4:43979] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 16:04:11,501 INFO [RS:1;jenkins-hbase4:43979] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:04:11,501 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:11,501 INFO [RS:1;jenkins-hbase4:43979] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:04:11,502 INFO [RS:1;jenkins-hbase4:43979] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:04:11,503 INFO [RS:1;jenkins-hbase4:43979] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43979 2023-02-13 16:04:11,505 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:11,505 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43979,1676304248382 2023-02-13 16:04:11,505 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:11,505 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:11,505 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:11,505 DEBUG [RS:0;jenkins-hbase4:44365] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/oldWALs 2023-02-13 16:04:11,505 INFO [RS:0;jenkins-hbase4:44365] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44365%2C1676304248356.meta:.meta(num 1676304248878) 2023-02-13 16:04:11,506 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43979,1676304248382] 2023-02-13 16:04:11,506 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43979,1676304248382; numProcessing=1 2023-02-13 16:04:11,507 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43979,1676304248382 already deleted, retry=false 2023-02-13 16:04:11,508 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43979,1676304248382 expired; onlineServers=1 2023-02-13 16:04:11,509 DEBUG [RS:0;jenkins-hbase4:44365] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/oldWALs 2023-02-13 16:04:11,509 INFO [RS:0;jenkins-hbase4:44365] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44365%2C1676304248356:(num 1676304249675) 2023-02-13 16:04:11,509 DEBUG [RS:0;jenkins-hbase4:44365] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:11,509 INFO [RS:0;jenkins-hbase4:44365] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:11,509 INFO [RS:0;jenkins-hbase4:44365] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-02-13 16:04:11,509 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:11,513 INFO [RS:0;jenkins-hbase4:44365] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44365 2023-02-13 16:04:11,607 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:11,607 INFO [RS:1;jenkins-hbase4:43979] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,43979,1676304248382; zookeeper connection closed. 2023-02-13 16:04:11,607 ERROR [Listener at localhost/40929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@22236dde rejected from java.util.concurrent.ThreadPoolExecutor@261cfd42[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:11,607 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x1004e6cd7990002, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:11,607 ERROR [Listener at localhost/40929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6b4328b2 rejected from java.util.concurrent.ThreadPoolExecutor@261cfd42[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:11,607 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5cd7fdcb] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5cd7fdcb 2023-02-13 16:04:11,608 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44365,1676304248356 2023-02-13 16:04:11,608 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:11,608 ERROR [Listener at localhost/40929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7ad9d571 rejected from java.util.concurrent.ThreadPoolExecutor@7ee64ef2[Terminated, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:11,611 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44365,1676304248356] 2023-02-13 16:04:11,611 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44365,1676304248356; numProcessing=2 2023-02-13 16:04:11,612 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44365,1676304248356 already deleted, retry=false 2023-02-13 16:04:11,612 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,44365,1676304248356 expired; onlineServers=0 2023-02-13 16:04:11,612 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,35089,1676304248301' ***** 2023-02-13 16:04:11,612 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 16:04:11,613 DEBUG [M:0;jenkins-hbase4:35089] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45844288, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:04:11,613 INFO [M:0;jenkins-hbase4:35089] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,35089,1676304248301 2023-02-13 16:04:11,613 INFO [M:0;jenkins-hbase4:35089] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,35089,1676304248301; all regions closed. 2023-02-13 16:04:11,613 DEBUG [M:0;jenkins-hbase4:35089] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:11,613 DEBUG [M:0;jenkins-hbase4:35089] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 16:04:11,613 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 16:04:11,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304248527] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304248527,5,FailOnTimeoutGroup] 2023-02-13 16:04:11,613 DEBUG [M:0;jenkins-hbase4:35089] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 16:04:11,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304248527] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304248527,5,FailOnTimeoutGroup] 2023-02-13 16:04:11,614 INFO [M:0;jenkins-hbase4:35089] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 16:04:11,615 INFO [M:0;jenkins-hbase4:35089] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 16:04:11,615 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:11,615 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:11,615 INFO [M:0;jenkins-hbase4:35089] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 16:04:11,615 DEBUG [M:0;jenkins-hbase4:35089] master.HMaster(1502): Stopping service threads 2023-02-13 16:04:11,615 INFO [M:0;jenkins-hbase4:35089] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 16:04:11,616 ERROR [M:0;jenkins-hbase4:35089] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 16:04:11,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:11,616 INFO [M:0;jenkins-hbase4:35089] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 16:04:11,616 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 16:04:11,616 DEBUG [M:0;jenkins-hbase4:35089] zookeeper.ZKUtil(398): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 16:04:11,616 WARN [M:0;jenkins-hbase4:35089] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 16:04:11,616 INFO [M:0;jenkins-hbase4:35089] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 16:04:11,617 INFO [M:0;jenkins-hbase4:35089] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 16:04:11,617 DEBUG [M:0;jenkins-hbase4:35089] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:04:11,617 INFO [M:0;jenkins-hbase4:35089] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:11,617 DEBUG [M:0;jenkins-hbase4:35089] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:11,617 DEBUG [M:0;jenkins-hbase4:35089] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:04:11,617 DEBUG [M:0;jenkins-hbase4:35089] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:11,617 INFO [M:0;jenkins-hbase4:35089] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=56.64 KB heapSize=67.59 KB 2023-02-13 16:04:11,626 INFO [M:0;jenkins-hbase4:35089] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=56.64 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/28a0d18221d34835a0ca365377959162 2023-02-13 16:04:11,630 DEBUG [M:0;jenkins-hbase4:35089] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/28a0d18221d34835a0ca365377959162 as hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/28a0d18221d34835a0ca365377959162 2023-02-13 16:04:11,633 INFO [M:0;jenkins-hbase4:35089] regionserver.HStore(1080): Added hdfs://localhost:45685/user/jenkins/test-data/3def50bb-ee35-0115-3a19-db8e793f49ca/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/28a0d18221d34835a0ca365377959162, entries=17, sequenceid=132, filesize=8.7 K 2023-02-13 16:04:11,634 INFO [M:0;jenkins-hbase4:35089] regionserver.HRegion(2947): Finished flush of dataSize ~56.64 KB/58000, heapSize ~67.58 KB/69200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false 2023-02-13 16:04:11,635 INFO [M:0;jenkins-hbase4:35089] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:11,635 DEBUG [M:0;jenkins-hbase4:35089] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304251617Disabling compacts and flushes for region at 1676304251617Disabling writes for close at 1676304251617Obtaining lock to block concurrent updates at 1676304251617Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676304251617Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=58000, getHeapSize=69200, getOffHeapSize=0, getCellsCount=145 at 1676304251618 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676304251618Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676304251619 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676304251621 (+2 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676304251621Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676304251630 (+9 ms)Finished flush of dataSize ~56.64 KB/58000, heapSize ~67.58 KB/69200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=132, compaction requested=false at 1676304251634 (+4 ms)Writing region close event to WAL at 1676304251635 (+1 ms)Closed at 1676304251635 2023-02-13 16:04:11,637 INFO [M:0;jenkins-hbase4:35089] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 16:04:11,637 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:11,638 INFO [M:0;jenkins-hbase4:35089] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35089 2023-02-13 16:04:11,639 DEBUG [M:0;jenkins-hbase4:35089] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35089,1676304248301 already deleted, retry=false 2023-02-13 16:04:11,793 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:11,793 INFO [M:0;jenkins-hbase4:35089] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,35089,1676304248301; zookeeper connection closed. 2023-02-13 16:04:11,793 ERROR [Listener at localhost/40929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4e7d32dd rejected from java.util.concurrent.ThreadPoolExecutor@4a42bfca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:11,794 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): master:35089-0x1004e6cd7990000, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:11,794 ERROR [Listener at localhost/40929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@194922b0 rejected from java.util.concurrent.ThreadPoolExecutor@4a42bfca[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:11,893 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:11,893 INFO [RS:0;jenkins-hbase4:44365] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,44365,1676304248356; zookeeper connection closed. 2023-02-13 16:04:11,893 ERROR [Listener at localhost/40929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3e53cf81 rejected from java.util.concurrent.ThreadPoolExecutor@7ee64ef2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:11,894 DEBUG [Listener at localhost/40929-EventThread] zookeeper.ZKWatcher(600): regionserver:44365-0x1004e6cd7990001, quorum=127.0.0.1:64776, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:11,894 ERROR [Listener at localhost/40929-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4648a909 rejected from java.util.concurrent.ThreadPoolExecutor@7ee64ef2[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:11,894 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4247c308] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4247c308 2023-02-13 16:04:11,894 INFO [Listener at localhost/40929] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 16:04:11,894 WARN [Listener at localhost/40929] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:04:11,898 INFO [Listener at localhost/40929] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:12,002 WARN [BP-665128647-172.31.14.131-1676304247720 heartbeating to localhost/127.0.0.1:45685] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:04:12,002 WARN [BP-665128647-172.31.14.131-1676304247720 heartbeating to localhost/127.0.0.1:45685] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-665128647-172.31.14.131-1676304247720 (Datanode Uuid 29b53ebb-a723-492f-ae24-4238b722c589) service to localhost/127.0.0.1:45685 2023-02-13 16:04:12,003 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/cluster_816c9471-fd3a-bb7f-a542-3b8d9878c365/dfs/data/data3/current/BP-665128647-172.31.14.131-1676304247720] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:12,003 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/cluster_816c9471-fd3a-bb7f-a542-3b8d9878c365/dfs/data/data4/current/BP-665128647-172.31.14.131-1676304247720] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:12,005 WARN [Listener at localhost/40929] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:04:12,008 INFO [Listener at localhost/40929] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:12,112 WARN [BP-665128647-172.31.14.131-1676304247720 heartbeating to localhost/127.0.0.1:45685] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:04:12,113 WARN [BP-665128647-172.31.14.131-1676304247720 heartbeating to localhost/127.0.0.1:45685] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-665128647-172.31.14.131-1676304247720 (Datanode Uuid 78e17e21-7a61-44ec-8f6f-4f7a8d26eeee) service to localhost/127.0.0.1:45685 2023-02-13 16:04:12,115 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/cluster_816c9471-fd3a-bb7f-a542-3b8d9878c365/dfs/data/data1/current/BP-665128647-172.31.14.131-1676304247720] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:12,115 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/cluster_816c9471-fd3a-bb7f-a542-3b8d9878c365/dfs/data/data2/current/BP-665128647-172.31.14.131-1676304247720] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:12,125 INFO [Listener at localhost/40929] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:12,243 INFO [Listener at localhost/40929] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 16:04:12,262 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 16:04:12,274 INFO [Listener at localhost/40929] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testRestoreSnapshotDoesNotCreateBackRefLinks Thread=277 (was 254) Potentially hanging thread: RS-EventLoopGroup-18-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:45685 from jenkins.hfs.11 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Listener at localhost/40929 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,35089,1676304248301)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:45685 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-22-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-22-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:45685 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-23-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ForkJoinPool-2-worker-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.ForkJoinPool.awaitWork(ForkJoinPool.java:1824) java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1693) java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-15 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.11@localhost:45685 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:45685 from jenkins.hfs.10 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-18-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-5-16 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-20-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:45685 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-25-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.10@localhost:45685 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-18-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-23-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-24-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-19-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=582 (was 643), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=320 (was 287) - SystemLoadAverage LEAK? -, ProcessCount=165 (was 165), AvailableMemoryMB=1409 (was 1455) 2023-02-13 16:04:12,285 INFO [Listener at localhost/40929] hbase.ResourceChecker(147): before: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=277, OpenFileDescriptor=581, MaxFileDescriptor=60000, SystemLoadAverage=320, ProcessCount=165, AvailableMemoryMB=1408 2023-02-13 16:04:12,296 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.log.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/hadoop.log.dir so I do NOT create it in target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b 2023-02-13 16:04:12,296 WARN [Listener at localhost/40929] hbase.HBaseTestingUtility(449): hadoop.log.dir property value differs in configuration and system: Configuration=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/../logs while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/hadoop.log.dir Erasing configuration value by system value. 2023-02-13 16:04:12,296 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(445): System.getProperty("hadoop.tmp.dir") already set to: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/hadoop.tmp.dir so I do NOT create it in target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b 2023-02-13 16:04:12,296 WARN [Listener at localhost/40929] hbase.HBaseTestingUtility(449): hadoop.tmp.dir property value differs in configuration and system: Configuration=/tmp/hadoop-jenkins while System=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/dc393f6d-156a-fd81-91bb-f9553c6b3176/hadoop.tmp.dir Erasing configuration value by system value. 2023-02-13 16:04:12,296 DEBUG [Listener at localhost/40929] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b 2023-02-13 16:04:12,296 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=true, createWALDir=false} 2023-02-13 16:04:12,296 INFO [Listener at localhost/40929] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/cluster_8ee46be2-6a6f-fcaf-f8fb-3bd93b162208, deleteOnExit=true 2023-02-13 16:04:12,296 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-13 16:04:12,296 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/test.cache.data in system properties and HBase conf 2023-02-13 16:04:12,296 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/hadoop.tmp.dir in system properties and HBase conf 2023-02-13 16:04:12,297 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/hadoop.log.dir in system properties and HBase conf 2023-02-13 16:04:12,297 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-13 16:04:12,297 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-13 16:04:12,297 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-13 16:04:12,297 DEBUG [Listener at localhost/40929] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-13 16:04:12,297 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:04:12,297 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-13 16:04:12,297 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-13 16:04:12,297 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:04:12,297 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-13 16:04:12,298 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-13 16:04:12,298 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-13 16:04:12,298 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:04:12,298 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-13 16:04:12,298 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/nfs.dump.dir in system properties and HBase conf 2023-02-13 16:04:12,298 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/java.io.tmpdir in system properties and HBase conf 2023-02-13 16:04:12,298 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-13 16:04:12,298 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-13 16:04:12,298 INFO [Listener at localhost/40929] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-13 16:04:12,302 WARN [Listener at localhost/40929] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:04:12,302 WARN [Listener at localhost/40929] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:04:12,340 WARN [Listener at localhost/40929] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:04:12,342 INFO [Listener at localhost/40929] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:04:12,347 INFO [Listener at localhost/40929] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/java.io.tmpdir/Jetty_localhost_36193_hdfs____.febdse/webapp 2023-02-13 16:04:12,439 INFO [Listener at localhost/40929] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36193 2023-02-13 16:04:12,443 WARN [Listener at localhost/40929] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-13 16:04:12,444 WARN [Listener at localhost/40929] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-13 16:04:12,544 WARN [Listener at localhost/41275] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:04:12,559 WARN [Listener at localhost/41275] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:04:12,562 WARN [Listener at localhost/41275] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:04:12,563 INFO [Listener at localhost/41275] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:04:12,569 INFO [Listener at localhost/41275] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/java.io.tmpdir/Jetty_localhost_42357_datanode____.4pzruq/webapp 2023-02-13 16:04:12,664 INFO [Listener at localhost/41275] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42357 2023-02-13 16:04:12,676 WARN [Listener at localhost/44597] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:04:12,702 WARN [Listener at localhost/44597] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-13 16:04:12,704 WARN [Listener at localhost/44597] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-13 16:04:12,705 INFO [Listener at localhost/44597] log.Slf4jLog(67): jetty-6.1.26 2023-02-13 16:04:12,716 INFO [Listener at localhost/44597] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/java.io.tmpdir/Jetty_localhost_41263_datanode____.a5um9z/webapp 2023-02-13 16:04:12,805 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xac6eca79921c09f: Processing first storage report for DS-71b0152d-bbaf-476a-93dd-f893f4f5732e from datanode c4e46b26-9be0-489f-b659-b336e2f2177b 2023-02-13 16:04:12,805 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xac6eca79921c09f: from storage DS-71b0152d-bbaf-476a-93dd-f893f4f5732e node DatanodeRegistration(127.0.0.1:39647, datanodeUuid=c4e46b26-9be0-489f-b659-b336e2f2177b, infoPort=35219, infoSecurePort=0, ipcPort=44597, storageInfo=lv=-57;cid=testClusterID;nsid=1989406986;c=1676304252305), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:12,805 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xac6eca79921c09f: Processing first storage report for DS-297cfb32-c4bf-46b5-8f0c-4c68965adb22 from datanode c4e46b26-9be0-489f-b659-b336e2f2177b 2023-02-13 16:04:12,805 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xac6eca79921c09f: from storage DS-297cfb32-c4bf-46b5-8f0c-4c68965adb22 node DatanodeRegistration(127.0.0.1:39647, datanodeUuid=c4e46b26-9be0-489f-b659-b336e2f2177b, infoPort=35219, infoSecurePort=0, ipcPort=44597, storageInfo=lv=-57;cid=testClusterID;nsid=1989406986;c=1676304252305), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:12,855 INFO [Listener at localhost/44597] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41263 2023-02-13 16:04:12,865 WARN [Listener at localhost/45519] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-13 16:04:12,979 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x996614d5ff05935d: Processing first storage report for DS-2d9f3376-d246-40ef-9e22-0f607b01f2bc from datanode 64f29041-0600-4422-b486-4b753b1f21d9 2023-02-13 16:04:12,979 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x996614d5ff05935d: from storage DS-2d9f3376-d246-40ef-9e22-0f607b01f2bc node DatanodeRegistration(127.0.0.1:41027, datanodeUuid=64f29041-0600-4422-b486-4b753b1f21d9, infoPort=37479, infoSecurePort=0, ipcPort=45519, storageInfo=lv=-57;cid=testClusterID;nsid=1989406986;c=1676304252305), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:12,979 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x996614d5ff05935d: Processing first storage report for DS-111414b6-b01a-452e-a531-b70897319b62 from datanode 64f29041-0600-4422-b486-4b753b1f21d9 2023-02-13 16:04:12,979 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x996614d5ff05935d: from storage DS-111414b6-b01a-452e-a531-b70897319b62 node DatanodeRegistration(127.0.0.1:41027, datanodeUuid=64f29041-0600-4422-b486-4b753b1f21d9, infoPort=37479, infoSecurePort=0, ipcPort=45519, storageInfo=lv=-57;cid=testClusterID;nsid=1989406986;c=1676304252305), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-13 16:04:12,988 DEBUG [Listener at localhost/45519] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b 2023-02-13 16:04:12,990 INFO [Listener at localhost/45519] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/cluster_8ee46be2-6a6f-fcaf-f8fb-3bd93b162208/zookeeper_0, clientPort=55214, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/cluster_8ee46be2-6a6f-fcaf-f8fb-3bd93b162208/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/cluster_8ee46be2-6a6f-fcaf-f8fb-3bd93b162208/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-13 16:04:12,991 INFO [Listener at localhost/45519] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55214 2023-02-13 16:04:12,992 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:12,993 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:13,005 INFO [Listener at localhost/45519] util.FSUtils(479): Created version file at hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7 with version=8 2023-02-13 16:04:13,005 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:13,006 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:13,007 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41275/user/jenkins/test-data/e2743cf7-36fa-de62-b6ad-88aea5735fff/hbase-staging 2023-02-13 16:04:13,009 INFO [Listener at localhost/45519] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:04:13,009 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:13,009 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:13,009 INFO [Listener at localhost/45519] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:04:13,009 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:13,009 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:04:13,009 INFO [Listener at localhost/45519] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:04:13,010 INFO [Listener at localhost/45519] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33331 2023-02-13 16:04:13,010 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:13,011 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:13,011 INFO [Listener at localhost/45519] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33331 connecting to ZooKeeper ensemble=127.0.0.1:55214 2023-02-13 16:04:13,018 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:333310x0, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:04:13,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:33331-0x1004e6cea030000 connected 2023-02-13 16:04:13,041 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:13,042 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:13,042 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:04:13,042 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33331 2023-02-13 16:04:13,043 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33331 2023-02-13 16:04:13,043 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33331 2023-02-13 16:04:13,044 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33331 2023-02-13 16:04:13,044 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33331 2023-02-13 16:04:13,044 INFO [Listener at localhost/45519] master.HMaster(439): hbase.rootdir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7, hbase.cluster.distributed=false 2023-02-13 16:04:13,062 INFO [Listener at localhost/45519] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:04:13,062 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:13,062 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:13,062 INFO [Listener at localhost/45519] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:04:13,062 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:13,062 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:04:13,062 INFO [Listener at localhost/45519] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:04:13,064 INFO [Listener at localhost/45519] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38947 2023-02-13 16:04:13,064 INFO [Listener at localhost/45519] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:04:13,064 DEBUG [Listener at localhost/45519] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:13,065 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:13,066 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:13,067 INFO [Listener at localhost/45519] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38947 connecting to ZooKeeper ensemble=127.0.0.1:55214 2023-02-13 16:04:13,069 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:389470x0, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:04:13,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38947-0x1004e6cea030001 connected 2023-02-13 16:04:13,072 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(164): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:13,073 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(164): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:13,073 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(164): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:04:13,073 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38947 2023-02-13 16:04:13,074 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38947 2023-02-13 16:04:13,076 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38947 2023-02-13 16:04:13,076 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38947 2023-02-13 16:04:13,076 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38947 2023-02-13 16:04:13,089 INFO [Listener at localhost/45519] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-02-13 16:04:13,089 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:13,089 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:13,089 INFO [Listener at localhost/45519] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-13 16:04:13,089 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-13 16:04:13,090 INFO [Listener at localhost/45519] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-13 16:04:13,090 INFO [Listener at localhost/45519] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-13 16:04:13,090 INFO [Listener at localhost/45519] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38537 2023-02-13 16:04:13,091 INFO [Listener at localhost/45519] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-13 16:04:13,091 DEBUG [Listener at localhost/45519] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:13,091 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:13,092 INFO [Listener at localhost/45519] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:13,093 INFO [Listener at localhost/45519] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38537 connecting to ZooKeeper ensemble=127.0.0.1:55214 2023-02-13 16:04:13,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:385370x0, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-13 16:04:13,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:38537-0x1004e6cea030002 connected 2023-02-13 16:04:13,096 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(164): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:13,097 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(164): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:13,097 DEBUG [Listener at localhost/45519] zookeeper.ZKUtil(164): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-13 16:04:13,097 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38537 2023-02-13 16:04:13,098 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38537 2023-02-13 16:04:13,098 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38537 2023-02-13 16:04:13,098 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38537 2023-02-13 16:04:13,099 DEBUG [Listener at localhost/45519] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38537 2023-02-13 16:04:13,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33331,1676304253008 2023-02-13 16:04:13,103 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:04:13,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33331,1676304253008 2023-02-13 16:04:13,105 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:13,105 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:13,105 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:13,105 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:13,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:04:13,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-13 16:04:13,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33331,1676304253008 from backup master directory 2023-02-13 16:04:13,113 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33331,1676304253008 2023-02-13 16:04:13,113 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-13 16:04:13,113 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:04:13,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase4.apache.org,33331,1676304253008 2023-02-13 16:04:13,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/hbase.id with ID: 84ccaea2-64f7-4813-afea-a47a28db3b4e 2023-02-13 16:04:13,131 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-13 16:04:13,133 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:13,140 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3064629f to 127.0.0.1:55214 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:13,143 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61c1de6a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:13,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:13,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-13 16:04:13,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:13,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/data/master/store-tmp 2023-02-13 16:04:13,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:13,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:04:13,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:13,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:13,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:04:13,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:13,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:13,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304253152Disabling compacts and flushes for region at 1676304253152Disabling writes for close at 1676304253152Writing region close event to WAL at 1676304253152Closed at 1676304253152 2023-02-13 16:04:13,153 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/WALs/jenkins-hbase4.apache.org,33331,1676304253008 2023-02-13 16:04:13,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33331%2C1676304253008, suffix=, logDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/WALs/jenkins-hbase4.apache.org,33331,1676304253008, archiveDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/oldWALs, maxLogs=10 2023-02-13 16:04:13,168 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41027,DS-2d9f3376-d246-40ef-9e22-0f607b01f2bc,DISK] 2023-02-13 16:04:13,168 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39647,DS-71b0152d-bbaf-476a-93dd-f893f4f5732e,DISK] 2023-02-13 16:04:13,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/WALs/jenkins-hbase4.apache.org,33331,1676304253008/jenkins-hbase4.apache.org%2C33331%2C1676304253008.1676304253154 2023-02-13 16:04:13,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41027,DS-2d9f3376-d246-40ef-9e22-0f607b01f2bc,DISK], DatanodeInfoWithStorage[127.0.0.1:39647,DS-71b0152d-bbaf-476a-93dd-f893f4f5732e,DISK]] 2023-02-13 16:04:13,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:13,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:13,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:13,170 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:13,171 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:13,172 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-13 16:04:13,172 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-13 16:04:13,173 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:13,173 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:13,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:13,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-13 16:04:13,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:13,177 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61903487, jitterRate=-0.07756616175174713}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:04:13,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676304253170Initializing all the Stores at 1676304253171 (+1 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304253171Cleaning up temporary data from old regions at 1676304253174 (+3 ms)Cleaning up detritus from prior splits at 1676304253174Region opened successfully at 1676304253177 (+3 ms) 2023-02-13 16:04:13,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-13 16:04:13,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-13 16:04:13,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-13 16:04:13,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-13 16:04:13,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 0 msec 2023-02-13 16:04:13,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 0 msec 2023-02-13 16:04:13,180 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-13 16:04:13,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-13 16:04:13,182 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-13 16:04:13,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-13 16:04:13,194 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-13 16:04:13,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-13 16:04:13,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-13 16:04:13,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-13 16:04:13,197 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:13,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-13 16:04:13,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-13 16:04:13,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-13 16:04:13,200 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:13,200 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:13,200 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:13,200 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:13,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase4.apache.org,33331,1676304253008, sessionid=0x1004e6cea030000, setting cluster-up flag (Was=false) 2023-02-13 16:04:13,206 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:13,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-13 16:04:13,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33331,1676304253008 2023-02-13 16:04:13,215 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:13,219 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-13 16:04:13,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33331,1676304253008 2023-02-13 16:04:13,220 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.hbase-snapshot/.tmp 2023-02-13 16:04:13,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-13 16:04:13,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:13,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:13,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:13,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-02-13 16:04:13,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-02-13 16:04:13,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:04:13,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,223 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676304283223 2023-02-13 16:04:13,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-13 16:04:13,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-13 16:04:13,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-13 16:04:13,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-13 16:04:13,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-13 16:04:13,224 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-13 16:04:13,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-13 16:04:13,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-13 16:04:13,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-13 16:04:13,226 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:04:13,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-13 16:04:13,226 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-13 16:04:13,226 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-13 16:04:13,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304253226,5,FailOnTimeoutGroup] 2023-02-13 16:04:13,226 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304253226,5,FailOnTimeoutGroup] 2023-02-13 16:04:13,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-13 16:04:13,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,227 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:13,236 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:13,236 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:13,236 INFO [PEWorker-2] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7 2023-02-13 16:04:13,243 DEBUG [PEWorker-2] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:13,243 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:04:13,245 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/info 2023-02-13 16:04:13,245 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:04:13,245 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:13,245 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:04:13,246 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:04:13,247 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:04:13,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:13,247 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:04:13,248 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/table 2023-02-13 16:04:13,248 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:04:13,249 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:13,249 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740 2023-02-13 16:04:13,250 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740 2023-02-13 16:04:13,251 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:04:13,252 DEBUG [PEWorker-2] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:04:13,254 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:13,254 INFO [PEWorker-2] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63438216, jitterRate=-0.05469691753387451}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:04:13,254 DEBUG [PEWorker-2] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676304253243Initializing all the Stores at 1676304253243Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304253243Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304253243Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304253243Cleaning up temporary data from old regions at 1676304253250 (+7 ms)Cleaning up detritus from prior splits at 1676304253251 (+1 ms)Region opened successfully at 1676304253254 (+3 ms) 2023-02-13 16:04:13,254 DEBUG [PEWorker-2] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:04:13,254 INFO [PEWorker-2] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:04:13,254 DEBUG [PEWorker-2] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:04:13,254 DEBUG [PEWorker-2] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:04:13,254 DEBUG [PEWorker-2] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:04:13,254 INFO [PEWorker-2] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:13,254 DEBUG [PEWorker-2] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304253254Disabling compacts and flushes for region at 1676304253254Disabling writes for close at 1676304253254Writing region close event to WAL at 1676304253254Closed at 1676304253254 2023-02-13 16:04:13,255 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-13 16:04:13,255 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-13 16:04:13,255 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-13 16:04:13,258 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-13 16:04:13,259 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-13 16:04:13,301 INFO [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(952): ClusterId : 84ccaea2-64f7-4813-afea-a47a28db3b4e 2023-02-13 16:04:13,301 INFO [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(952): ClusterId : 84ccaea2-64f7-4813-afea-a47a28db3b4e 2023-02-13 16:04:13,301 DEBUG [RS:0;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:04:13,301 DEBUG [RS:1;jenkins-hbase4:38537] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-13 16:04:13,303 DEBUG [RS:0;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:04:13,303 DEBUG [RS:1;jenkins-hbase4:38537] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-13 16:04:13,303 DEBUG [RS:1;jenkins-hbase4:38537] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:04:13,303 DEBUG [RS:0;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-13 16:04:13,304 DEBUG [RS:1;jenkins-hbase4:38537] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:04:13,305 DEBUG [RS:0;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-13 16:04:13,306 DEBUG [RS:1;jenkins-hbase4:38537] zookeeper.ReadOnlyZKClient(139): Connect 0x5c765b59 to 127.0.0.1:55214 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:13,306 DEBUG [RS:0;jenkins-hbase4:38947] zookeeper.ReadOnlyZKClient(139): Connect 0x0ad5c52b to 127.0.0.1:55214 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:13,310 DEBUG [RS:0;jenkins-hbase4:38947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4122a01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:13,310 DEBUG [RS:1;jenkins-hbase4:38537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52b1bea7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:13,310 DEBUG [RS:0;jenkins-hbase4:38947] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dae5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:04:13,310 DEBUG [RS:1;jenkins-hbase4:38537] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@568e3029, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:04:13,320 DEBUG [RS:0;jenkins-hbase4:38947] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38947 2023-02-13 16:04:13,320 DEBUG [RS:1;jenkins-hbase4:38537] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38537 2023-02-13 16:04:13,320 INFO [RS:0;jenkins-hbase4:38947] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:04:13,320 INFO [RS:0;jenkins-hbase4:38947] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:04:13,320 INFO [RS:1;jenkins-hbase4:38537] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-13 16:04:13,320 INFO [RS:1;jenkins-hbase4:38537] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-13 16:04:13,320 DEBUG [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:04:13,320 DEBUG [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(1023): About to register with Master. 2023-02-13 16:04:13,320 INFO [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33331,1676304253008 with isa=jenkins-hbase4.apache.org/172.31.14.131:38947, startcode=1676304253061 2023-02-13 16:04:13,320 INFO [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase4.apache.org,33331,1676304253008 with isa=jenkins-hbase4.apache.org/172.31.14.131:38537, startcode=1676304253089 2023-02-13 16:04:13,320 DEBUG [RS:0;jenkins-hbase4:38947] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:04:13,320 DEBUG [RS:1;jenkins-hbase4:38537] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-13 16:04:13,322 INFO [RS-EventLoopGroup-21-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57071, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.12 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:04:13,322 INFO [RS-EventLoopGroup-21-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33683, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.13 (auth:SIMPLE), service=RegionServerStatusService 2023-02-13 16:04:13,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33331] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:13,324 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:13,324 DEBUG [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7 2023-02-13 16:04:13,324 DEBUG [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41275 2023-02-13 16:04:13,325 DEBUG [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7 2023-02-13 16:04:13,325 DEBUG [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:04:13,325 DEBUG [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:41275 2023-02-13 16:04:13,325 DEBUG [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-13 16:04:13,326 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:13,329 DEBUG [RS:0;jenkins-hbase4:38947] zookeeper.ZKUtil(162): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:13,329 WARN [RS:0;jenkins-hbase4:38947] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:04:13,329 INFO [RS:0;jenkins-hbase4:38947] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:13,330 DEBUG [RS:1;jenkins-hbase4:38537] zookeeper.ZKUtil(162): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:13,330 DEBUG [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/WALs/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:13,330 WARN [RS:1;jenkins-hbase4:38537] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-13 16:04:13,330 INFO [RS:1;jenkins-hbase4:38537] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:13,330 DEBUG [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1947): logDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/WALs/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:13,330 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38947,1676304253061] 2023-02-13 16:04:13,330 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38537,1676304253089] 2023-02-13 16:04:13,338 DEBUG [RS:0;jenkins-hbase4:38947] zookeeper.ZKUtil(162): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:13,338 DEBUG [RS:1;jenkins-hbase4:38537] zookeeper.ZKUtil(162): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:13,338 DEBUG [RS:1;jenkins-hbase4:38537] zookeeper.ZKUtil(162): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:13,339 DEBUG [RS:0;jenkins-hbase4:38947] zookeeper.ZKUtil(162): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:13,339 DEBUG [RS:0;jenkins-hbase4:38947] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:04:13,339 DEBUG [RS:1;jenkins-hbase4:38537] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-13 16:04:13,340 INFO [RS:0;jenkins-hbase4:38947] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:04:13,340 INFO [RS:1;jenkins-hbase4:38537] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-13 16:04:13,341 INFO [RS:0;jenkins-hbase4:38947] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:04:13,341 INFO [RS:0;jenkins-hbase4:38947] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:04:13,341 INFO [RS:0;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,342 INFO [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:04:13,344 INFO [RS:1;jenkins-hbase4:38537] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-13 16:04:13,345 INFO [RS:1;jenkins-hbase4:38537] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-13 16:04:13,345 INFO [RS:1;jenkins-hbase4:38537] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,345 INFO [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-13 16:04:13,352 INFO [RS:0;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,353 DEBUG [RS:0;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,353 DEBUG [RS:0;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,353 DEBUG [RS:0;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,353 INFO [RS:1;jenkins-hbase4:38537] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,353 DEBUG [RS:0;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,353 DEBUG [RS:0;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,353 DEBUG [RS:0;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:04:13,353 DEBUG [RS:1;jenkins-hbase4:38537] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,353 DEBUG [RS:0;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:1;jenkins-hbase4:38537] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:0;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:1;jenkins-hbase4:38537] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:0;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:1;jenkins-hbase4:38537] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:0;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:1;jenkins-hbase4:38537] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:1;jenkins-hbase4:38537] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-02-13 16:04:13,354 DEBUG [RS:1;jenkins-hbase4:38537] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:1;jenkins-hbase4:38537] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:1;jenkins-hbase4:38537] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,354 DEBUG [RS:1;jenkins-hbase4:38537] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-02-13 16:04:13,359 INFO [RS:0;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,359 INFO [RS:0;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,359 INFO [RS:0;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,360 INFO [RS:1;jenkins-hbase4:38537] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,360 INFO [RS:1;jenkins-hbase4:38537] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,360 INFO [RS:1;jenkins-hbase4:38537] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,375 INFO [RS:0;jenkins-hbase4:38947] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:04:13,375 INFO [RS:0;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38947,1676304253061-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,386 INFO [RS:1;jenkins-hbase4:38537] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-13 16:04:13,386 INFO [RS:1;jenkins-hbase4:38537] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38537,1676304253089-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,399 INFO [RS:0;jenkins-hbase4:38947] regionserver.Replication(203): jenkins-hbase4.apache.org,38947,1676304253061 started 2023-02-13 16:04:13,399 INFO [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38947,1676304253061, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38947, sessionid=0x1004e6cea030001 2023-02-13 16:04:13,399 DEBUG [RS:0;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:04:13,399 DEBUG [RS:0;jenkins-hbase4:38947] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:13,399 DEBUG [RS:0;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38947,1676304253061' 2023-02-13 16:04:13,399 DEBUG [RS:0;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:13,400 DEBUG [RS:0;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:13,400 DEBUG [RS:0;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:04:13,400 DEBUG [RS:0;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:04:13,400 DEBUG [RS:0;jenkins-hbase4:38947] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:13,400 DEBUG [RS:0;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38947,1676304253061' 2023-02-13 16:04:13,400 DEBUG [RS:0;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:13,401 DEBUG [RS:0;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:13,401 DEBUG [RS:0;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:04:13,401 INFO [RS:0;jenkins-hbase4:38947] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:04:13,401 INFO [RS:0;jenkins-hbase4:38947] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:04:13,403 INFO [RS:1;jenkins-hbase4:38537] regionserver.Replication(203): jenkins-hbase4.apache.org,38537,1676304253089 started 2023-02-13 16:04:13,403 INFO [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1638): Serving as jenkins-hbase4.apache.org,38537,1676304253089, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38537, sessionid=0x1004e6cea030002 2023-02-13 16:04:13,403 DEBUG [RS:1;jenkins-hbase4:38537] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-13 16:04:13,403 DEBUG [RS:1;jenkins-hbase4:38537] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:13,403 DEBUG [RS:1;jenkins-hbase4:38537] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38537,1676304253089' 2023-02-13 16:04:13,403 DEBUG [RS:1;jenkins-hbase4:38537] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:13,403 DEBUG [RS:1;jenkins-hbase4:38537] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:13,403 DEBUG [RS:1;jenkins-hbase4:38537] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-13 16:04:13,403 DEBUG [RS:1;jenkins-hbase4:38537] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-13 16:04:13,403 DEBUG [RS:1;jenkins-hbase4:38537] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:13,404 DEBUG [RS:1;jenkins-hbase4:38537] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38537,1676304253089' 2023-02-13 16:04:13,404 DEBUG [RS:1;jenkins-hbase4:38537] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:13,404 DEBUG [RS:1;jenkins-hbase4:38537] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:13,404 DEBUG [RS:1;jenkins-hbase4:38537] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-13 16:04:13,404 INFO [RS:1;jenkins-hbase4:38537] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-13 16:04:13,404 INFO [RS:1;jenkins-hbase4:38537] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-13 16:04:13,410 DEBUG [jenkins-hbase4:33331] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=2, allServersCount=2 2023-02-13 16:04:13,410 DEBUG [jenkins-hbase4:33331] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:04:13,411 DEBUG [jenkins-hbase4:33331] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:04:13,411 DEBUG [jenkins-hbase4:33331] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:04:13,411 DEBUG [jenkins-hbase4:33331] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:04:13,411 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38537,1676304253089, state=OPENING 2023-02-13 16:04:13,414 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-13 16:04:13,415 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:13,415 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38537,1676304253089}] 2023-02-13 16:04:13,415 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:04:13,570 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:13,570 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:04:13,572 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:04:13,576 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-13 16:04:13,576 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-13 16:04:13,577 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38537%2C1676304253089.meta, suffix=.meta, logDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/WALs/jenkins-hbase4.apache.org,38537,1676304253089, archiveDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/oldWALs, maxLogs=32 2023-02-13 16:04:13,594 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41027,DS-2d9f3376-d246-40ef-9e22-0f607b01f2bc,DISK] 2023-02-13 16:04:13,594 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39647,DS-71b0152d-bbaf-476a-93dd-f893f4f5732e,DISK] 2023-02-13 16:04:13,595 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/WALs/jenkins-hbase4.apache.org,38537,1676304253089/jenkins-hbase4.apache.org%2C38537%2C1676304253089.meta.1676304253577.meta 2023-02-13 16:04:13,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41027,DS-2d9f3376-d246-40ef-9e22-0f607b01f2bc,DISK], DatanodeInfoWithStorage[127.0.0.1:39647,DS-71b0152d-bbaf-476a-93dd-f893f4f5732e,DISK]] 2023-02-13 16:04:13,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:13,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-13 16:04:13,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-13 16:04:13,596 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-13 16:04:13,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-13 16:04:13,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:13,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-13 16:04:13,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-13 16:04:13,598 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-13 16:04:13,598 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/info 2023-02-13 16:04:13,598 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/info 2023-02-13 16:04:13,599 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-13 16:04:13,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:13,599 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-13 16:04:13,600 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:04:13,600 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/rep_barrier 2023-02-13 16:04:13,600 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-13 16:04:13,601 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:13,601 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-13 16:04:13,601 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/table 2023-02-13 16:04:13,602 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/table 2023-02-13 16:04:13,602 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-13 16:04:13,602 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:13,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740 2023-02-13 16:04:13,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740 2023-02-13 16:04:13,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-13 16:04:13,606 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-13 16:04:13,607 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72489127, jitterRate=0.08017216622829437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-13 16:04:13,607 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676304253597Writing region info on filesystem at 1676304253597Initializing all the Stores at 1676304253597Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304253597Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304253597Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304253597Cleaning up temporary data from old regions at 1676304253604 (+7 ms)Cleaning up detritus from prior splits at 1676304253605 (+1 ms)Running coprocessor post-open hooks at 1676304253607 (+2 ms)Region opened successfully at 1676304253607 2023-02-13 16:04:13,608 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676304253570 2023-02-13 16:04:13,612 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-13 16:04:13,614 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-13 16:04:13,614 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38537,1676304253089, state=OPEN 2023-02-13 16:04:13,616 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-13 16:04:13,616 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-13 16:04:13,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-13 16:04:13,617 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38537,1676304253089 in 201 msec 2023-02-13 16:04:13,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-13 16:04:13,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 362 msec 2023-02-13 16:04:13,620 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 398 msec 2023-02-13 16:04:13,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676304253103, completionTime=-1 2023-02-13 16:04:13,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2023-02-13 16:04:13,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-13 16:04:13,622 DEBUG [hconnection-0x6b2cf2f3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:13,623 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56822, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:13,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=2 2023-02-13 16:04:13,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676304313624 2023-02-13 16:04:13,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676304373624 2023-02-13 16:04:13,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 4 msec 2023-02-13 16:04:13,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33331,1676304253008-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33331,1676304253008-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33331,1676304253008-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33331, period=300000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-13 16:04:13,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-13 16:04:13,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:13,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-13 16:04:13,632 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:04:13,632 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-13 16:04:13,633 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:04:13,634 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:13,635 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b empty. 2023-02-13 16:04:13,635 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:13,635 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-13 16:04:13,672 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:13,673 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 18a8724af1e2eef2d70399439d08488b, NAME => 'hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp 2023-02-13 16:04:13,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:13,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 18a8724af1e2eef2d70399439d08488b, disabling compactions & flushes 2023-02-13 16:04:13,679 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:13,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:13,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. after waiting 0 ms 2023-02-13 16:04:13,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:13,679 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:13,679 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 18a8724af1e2eef2d70399439d08488b: Waiting for close lock at 1676304253679Disabling compacts and flushes for region at 1676304253679Disabling writes for close at 1676304253679Writing region close event to WAL at 1676304253679Closed at 1676304253679 2023-02-13 16:04:13,681 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:04:13,682 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304253682"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304253682"}]},"ts":"1676304253682"} 2023-02-13 16:04:13,684 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:04:13,685 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:04:13,686 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304253686"}]},"ts":"1676304253686"} 2023-02-13 16:04:13,687 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-13 16:04:13,689 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:04:13,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:04:13,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:04:13,690 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:04:13,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=18a8724af1e2eef2d70399439d08488b, ASSIGN}] 2023-02-13 16:04:13,692 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=18a8724af1e2eef2d70399439d08488b, ASSIGN 2023-02-13 16:04:13,693 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=18a8724af1e2eef2d70399439d08488b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38537,1676304253089; forceNewPlan=false, retain=false 2023-02-13 16:04:13,843 INFO [jenkins-hbase4:33331] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:04:13,843 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=18a8724af1e2eef2d70399439d08488b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:13,844 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304253843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304253843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304253843"}]},"ts":"1676304253843"} 2023-02-13 16:04:13,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 18a8724af1e2eef2d70399439d08488b, server=jenkins-hbase4.apache.org,38537,1676304253089}] 2023-02-13 16:04:14,000 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:14,001 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38537%2C1676304253089, suffix=, logDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/WALs/jenkins-hbase4.apache.org,38537,1676304253089, archiveDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/oldWALs, maxLogs=32 2023-02-13 16:04:14,016 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39647,DS-71b0152d-bbaf-476a-93dd-f893f4f5732e,DISK] 2023-02-13 16:04:14,016 DEBUG [RS-EventLoopGroup-23-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41027,DS-2d9f3376-d246-40ef-9e22-0f607b01f2bc,DISK] 2023-02-13 16:04:14,018 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/WALs/jenkins-hbase4.apache.org,38537,1676304253089/jenkins-hbase4.apache.org%2C38537%2C1676304253089.1676304254001 2023-02-13 16:04:14,018 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41027,DS-2d9f3376-d246-40ef-9e22-0f607b01f2bc,DISK], DatanodeInfoWithStorage[127.0.0.1:39647,DS-71b0152d-bbaf-476a-93dd-f893f4f5732e,DISK]] 2023-02-13 16:04:14,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 18a8724af1e2eef2d70399439d08488b, NAME => 'hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:14,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:14,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:14,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for 18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:14,019 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for 18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:14,020 INFO [StoreOpener-18a8724af1e2eef2d70399439d08488b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:14,021 DEBUG [StoreOpener-18a8724af1e2eef2d70399439d08488b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b/info 2023-02-13 16:04:14,021 DEBUG [StoreOpener-18a8724af1e2eef2d70399439d08488b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b/info 2023-02-13 16:04:14,021 INFO [StoreOpener-18a8724af1e2eef2d70399439d08488b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 18a8724af1e2eef2d70399439d08488b columnFamilyName info 2023-02-13 16:04:14,022 INFO [StoreOpener-18a8724af1e2eef2d70399439d08488b-1] regionserver.HStore(310): Store=18a8724af1e2eef2d70399439d08488b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:14,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:14,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:14,024 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for 18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:14,026 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:14,026 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened 18a8724af1e2eef2d70399439d08488b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73595730, jitterRate=0.09666183590888977}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-13 16:04:14,026 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for 18a8724af1e2eef2d70399439d08488b: Running coprocessor pre-open hook at 1676304254019Writing region info on filesystem at 1676304254019Initializing all the Stores at 1676304254020 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676304254020Cleaning up temporary data from old regions at 1676304254023 (+3 ms)Cleaning up detritus from prior splits at 1676304254023Running coprocessor post-open hooks at 1676304254026 (+3 ms)Region opened successfully at 1676304254026 2023-02-13 16:04:14,027 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b., pid=6, masterSystemTime=1676304253997 2023-02-13 16:04:14,028 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:14,029 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:14,030 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=18a8724af1e2eef2d70399439d08488b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:14,030 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676304254029"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304254029"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304254029"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304254029"}]},"ts":"1676304254029"} 2023-02-13 16:04:14,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-13 16:04:14,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 18a8724af1e2eef2d70399439d08488b, server=jenkins-hbase4.apache.org,38537,1676304253089 in 186 msec 2023-02-13 16:04:14,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-13 16:04:14,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=18a8724af1e2eef2d70399439d08488b, ASSIGN in 342 msec 2023-02-13 16:04:14,034 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:04:14,034 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304254034"}]},"ts":"1676304254034"} 2023-02-13 16:04:14,035 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-13 16:04:14,037 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:04:14,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 407 msec 2023-02-13 16:04:14,132 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-13 16:04:14,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:04:14,134 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:14,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-13 16:04:14,144 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:04:14,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 8 msec 2023-02-13 16:04:14,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-13 16:04:14,155 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-13 16:04:14,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 9 msec 2023-02-13 16:04:14,162 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-13 16:04:14,166 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-13 16:04:14,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 1.053sec 2023-02-13 16:04:14,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-13 16:04:14,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-13 16:04:14,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-13 16:04:14,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33331,1676304253008-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-13 16:04:14,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33331,1676304253008-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-13 16:04:14,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-13 16:04:14,201 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(139): Connect 0x74a4015e to 127.0.0.1:55214 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:14,204 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31481479, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:14,206 DEBUG [hconnection-0x6160dc35-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:14,207 INFO [RS-EventLoopGroup-23-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56828, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:14,209 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33331,1676304253008 2023-02-13 16:04:14,209 DEBUG [Listener at localhost/45519] mapreduce.TableSnapshotInputFormatTestBase(193): Ensuring table doesn't exist. 2023-02-13 16:04:14,212 DEBUG [Listener at localhost/45519] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-13 16:04:14,213 INFO [RS-EventLoopGroup-21-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57464, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-13 16:04:14,213 INFO [Listener at localhost/45519] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 16:04:14,214 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 16:04:14,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.checkTableModifiable(AbstractStateMachineTableProcedure.java:125) at org.apache.hadoop.hbase.master.procedure.AbstractStateMachineTableProcedure.preflightChecks(AbstractStateMachineTableProcedure.java:157) at org.apache.hadoop.hbase.master.procedure.DisableTableProcedure.(DisableTableProcedure.java:78) at org.apache.hadoop.hbase.master.HMaster$11.run(HMaster.java:2416) at org.apache.hadoop.hbase.master.procedure.MasterProcedureUtil.submitProcedure(MasterProcedureUtil.java:132) at org.apache.hadoop.hbase.master.HMaster.disableTable(HMaster.java:2400) at org.apache.hadoop.hbase.master.MasterRpcServices.disableTable(MasterRpcServices.java:784) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-13 16:04:14,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] ipc.CallRunner(144): callId: 2 service: MasterService methodName: DisableTable size: 76 connection: 172.31.14.131:57464 deadline: 1676304314214, exception=org.apache.hadoop.hbase.TableNotFoundException: testWithMapReduce 2023-02-13 16:04:14,214 INFO [Listener at localhost/45519] mapreduce.TableSnapshotInputFormatTestBase(199): creating table 'testWithMapReduce' 2023-02-13 16:04:14,217 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.HMaster$4(2102): Client=jenkins//172.31.14.131 create 'testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-13 16:04:14,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] procedure2.ProcedureExecutor(1029): Stored pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testWithMapReduce 2023-02-13 16:04:14,220 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_PRE_OPERATION 2023-02-13 16:04:14,220 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(697): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testWithMapReduce" procId is: 10 2023-02-13 16:04:14,221 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-13 16:04:14,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:14,222 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:14,223 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf empty. 2023-02-13 16:04:14,223 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:14,223 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 16:04:14,232 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/.tabledesc/.tableinfo.0000000001 2023-02-13 16:04:14,233 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(7671): creating {ENCODED => b8e7ae6faaaed9f3487d22335be948bf, NAME => 'testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp 2023-02-13 16:04:14,239 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:14,239 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1603): Closing b8e7ae6faaaed9f3487d22335be948bf, disabling compactions & flushes 2023-02-13 16:04:14,240 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:14,240 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:14,240 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. after waiting 0 ms 2023-02-13 16:04:14,240 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:14,240 INFO [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:14,240 DEBUG [RegionOpenAndInit-testWithMapReduce-pool-0] regionserver.HRegion(1557): Region close journal for b8e7ae6faaaed9f3487d22335be948bf: Waiting for close lock at 1676304254239Disabling compacts and flushes for region at 1676304254239Disabling writes for close at 1676304254240 (+1 ms)Writing region close event to WAL at 1676304254240Closed at 1676304254240 2023-02-13 16:04:14,242 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ADD_TO_META 2023-02-13 16:04:14,243 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676304254242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304254242"}]},"ts":"1676304254242"} 2023-02-13 16:04:14,244 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-13 16:04:14,244 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-13 16:04:14,245 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304254245"}]},"ts":"1676304254245"} 2023-02-13 16:04:14,246 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLING in hbase:meta 2023-02-13 16:04:14,248 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-02-13 16:04:14,249 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-02-13 16:04:14,249 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-02-13 16:04:14,249 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-02-13 16:04:14,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b8e7ae6faaaed9f3487d22335be948bf, ASSIGN}] 2023-02-13 16:04:14,250 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testWithMapReduce, region=b8e7ae6faaaed9f3487d22335be948bf, ASSIGN 2023-02-13 16:04:14,251 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=11, ppid=10, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testWithMapReduce, region=b8e7ae6faaaed9f3487d22335be948bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38947,1676304253061; forceNewPlan=false, retain=false 2023-02-13 16:04:14,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:14,401 INFO [jenkins-hbase4:33331] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-02-13 16:04:14,401 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b8e7ae6faaaed9f3487d22335be948bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:14,401 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676304254401"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304254401"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304254401"}]},"ts":"1676304254401"} 2023-02-13 16:04:14,403 INFO [RS:0;jenkins-hbase4:38947] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38947%2C1676304253061, suffix=, logDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/WALs/jenkins-hbase4.apache.org,38947,1676304253061, archiveDir=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/oldWALs, maxLogs=32 2023-02-13 16:04:14,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=12, ppid=11, state=RUNNABLE; OpenRegionProcedure b8e7ae6faaaed9f3487d22335be948bf, server=jenkins-hbase4.apache.org,38947,1676304253061}] 2023-02-13 16:04:14,421 DEBUG [RS-EventLoopGroup-23-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39647,DS-71b0152d-bbaf-476a-93dd-f893f4f5732e,DISK] 2023-02-13 16:04:14,421 DEBUG [RS-EventLoopGroup-23-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41027,DS-2d9f3376-d246-40ef-9e22-0f607b01f2bc,DISK] 2023-02-13 16:04:14,422 INFO [RS:0;jenkins-hbase4:38947] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/WALs/jenkins-hbase4.apache.org,38947,1676304253061/jenkins-hbase4.apache.org%2C38947%2C1676304253061.1676304254403 2023-02-13 16:04:14,424 DEBUG [RS:0;jenkins-hbase4:38947] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39647,DS-71b0152d-bbaf-476a-93dd-f893f4f5732e,DISK], DatanodeInfoWithStorage[127.0.0.1:41027,DS-2d9f3376-d246-40ef-9e22-0f607b01f2bc,DISK]] 2023-02-13 16:04:14,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:14,565 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:14,565 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-13 16:04:14,567 INFO [RS-EventLoopGroup-22-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40230, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-13 16:04:14,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(128): Open testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:14,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b8e7ae6faaaed9f3487d22335be948bf, NAME => 'testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.', STARTKEY => '', ENDKEY => ''} 2023-02-13 16:04:14,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testWithMapReduce b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:14,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:14,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7890): checking encryption for b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:14,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7893): checking classloading for b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:14,572 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:14,573 DEBUG [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1 2023-02-13 16:04:14,573 DEBUG [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1 2023-02-13 16:04:14,573 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8e7ae6faaaed9f3487d22335be948bf columnFamilyName f1 2023-02-13 16:04:14,574 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] regionserver.HStore(310): Store=b8e7ae6faaaed9f3487d22335be948bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:14,574 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:14,575 DEBUG [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2 2023-02-13 16:04:14,575 DEBUG [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2 2023-02-13 16:04:14,575 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8e7ae6faaaed9f3487d22335be948bf columnFamilyName f2 2023-02-13 16:04:14,576 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] regionserver.HStore(310): Store=b8e7ae6faaaed9f3487d22335be948bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:14,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:14,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:14,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:14,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1054): writing seq id for b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:14,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-13 16:04:14,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1071): Opened b8e7ae6faaaed9f3487d22335be948bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61258860, jitterRate=-0.08717185258865356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:14,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(964): Region open journal for b8e7ae6faaaed9f3487d22335be948bf: Running coprocessor pre-open hook at 1676304254571Writing region info on filesystem at 1676304254571Initializing all the Stores at 1676304254571Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304254571Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304254571Cleaning up temporary data from old regions at 1676304254577 (+6 ms)Cleaning up detritus from prior splits at 1676304254578 (+1 ms)Running coprocessor post-open hooks at 1676304254582 (+4 ms)Region opened successfully at 1676304254582 2023-02-13 16:04:14,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf., pid=12, masterSystemTime=1676304254565 2023-02-13 16:04:14,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:14,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(156): Opened testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:14,587 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=11 updating hbase:meta row=b8e7ae6faaaed9f3487d22335be948bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:14,587 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676304254587"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1676304254587"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676304254587"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676304254587"}]},"ts":"1676304254587"} 2023-02-13 16:04:14,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=12, resume processing ppid=11 2023-02-13 16:04:14,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, ppid=11, state=SUCCESS; OpenRegionProcedure b8e7ae6faaaed9f3487d22335be948bf, server=jenkins-hbase4.apache.org,38947,1676304253061 in 176 msec 2023-02-13 16:04:14,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-13 16:04:14,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b8e7ae6faaaed9f3487d22335be948bf, ASSIGN in 344 msec 2023-02-13 16:04:14,595 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-13 16:04:14,595 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304254595"}]},"ts":"1676304254595"} 2023-02-13 16:04:14,596 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=ENABLED in hbase:meta 2023-02-13 16:04:14,599 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=10, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testWithMapReduce execute state=CREATE_TABLE_POST_OPERATION 2023-02-13 16:04:14,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, state=SUCCESS; CreateTableProcedure table=testWithMapReduce in 382 msec 2023-02-13 16:04:14,794 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-datanode.properties,hadoop-metrics2.properties 2023-02-13 16:04:14,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1227): Checking to see if procedure is done pid=10 2023-02-13 16:04:14,827 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testWithMapReduce, procId: 10 completed 2023-02-13 16:04:14,827 DEBUG [Listener at localhost/45519] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testWithMapReduce get assigned. Timeout = 60000ms 2023-02-13 16:04:14,827 INFO [Listener at localhost/45519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:04:14,831 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(3484): All regions for table testWithMapReduce assigned to meta. Checking AM states. 2023-02-13 16:04:14,831 INFO [Listener at localhost/45519] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-13 16:04:14,832 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(3504): All regions for table testWithMapReduce assigned. 2023-02-13 16:04:14,832 INFO [Listener at localhost/45519] mapreduce.TableSnapshotInputFormatTestBase(207): put some stuff in the table 2023-02-13 16:04:14,855 DEBUG [hconnection-0x6160dc35-shared-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:14,875 INFO [RS-EventLoopGroup-22-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40246, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:14,887 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:14,992 INFO [Listener at localhost/45519] mapreduce.TableSnapshotInputFormatTestBase(214): snapshot 2023-02-13 16:04:14,992 INFO [Listener at localhost/45519] snapshot.SnapshotTestingUtils(396): taking snapshot. 2023-02-13 16:04:14,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1580): Client=jenkins//172.31.14.131 snapshot request for:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 16:04:14,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676304254993 (current time:1676304254993). 2023-02-13 16:04:14,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-13 16:04:14,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] zookeeper.ReadOnlyZKClient(139): Connect 0x6b789d0e to 127.0.0.1:55214 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-13 16:04:14,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2636a669, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-13 16:04:14,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-13 16:04:14,998 INFO [RS-EventLoopGroup-23-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56834, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-13 16:04:14,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b789d0e to 127.0.0.1:55214 2023-02-13 16:04:14,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:14,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-13 16:04:14,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 16:04:15,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 16:04:15,002 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=13, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 16:04:15,003 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=13, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE; timeout=600000, timestamp=1676304855003 2023-02-13 16:04:15,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] snapshot.SnapshotManager(653): Started snapshot: { ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } 2023-02-13 16:04:15,003 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce 2023-02-13 16:04:15,006 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-02-13 16:04:15,006 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-13 16:04:15,006 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=13, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE 2023-02-13 16:04:15,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 16:04:15,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=EXCLUSIVE in 6 msec 2023-02-13 16:04:15,008 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=14, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 16:04:15,008 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=14, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED; timeout=600000, timestamp=1676304855008 2023-02-13 16:04:15,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduceSingleRegion 2023-02-13 16:04:15,016 INFO [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduceSingleRegion' 2023-02-13 16:04:15,016 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:04:15,017 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduceSingleRegion' starting 'acquire' 2023-02-13 16:04:15,017 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduceSingleRegion', kicking off acquire phase on members. 2023-02-13 16:04:15,017 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,017 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 16:04:15,018 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:15,018 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:15,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:15,018 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:15,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:15,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:15,019 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 16:04:15,019 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:04:15,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 16:04:15,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,019 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-13 16:04:15,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 16:04:15,020 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-13 16:04:15,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 67 2023-02-13 16:04:15,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 16:04:15,020 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot testWithMapReduceSingleRegion from table testWithMapReduce type FLUSH 2023-02-13 16:04:15,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-13 16:04:15,020 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduceSingleRegion 2023-02-13 16:04:15,020 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-13 16:04:15,020 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:04:15,020 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduceSingleRegion' with timeout 300000ms 2023-02-13 16:04:15,021 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-13 16:04:15,021 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 16:04:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduceSingleRegion' starting 'acquire' stage 2023-02-13 16:04:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-13 16:04:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38947,1676304253061' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-13 16:04:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduceSingleRegion' locally acquired 2023-02-13 16:04:15,023 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38537,1676304253089' joining acquired barrier for procedure (testWithMapReduceSingleRegion) in zk 2023-02-13 16:04:15,026 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,026 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,026 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:15,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:04:15,027 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,027 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:15,027 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,027 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduceSingleRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:15,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:15,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:15,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 16:04:15,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:15,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38947,1676304253061' joining acquired barrier for procedure 'testWithMapReduceSingleRegion' on coordinator 2023-02-13 16:04:15,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ae6de2a[Count = 0] remaining members to acquire global barrier 2023-02-13 16:04:15,028 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduceSingleRegion' starting 'in-barrier' execution. 2023-02-13 16:04:15,028 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,029 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,029 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,030 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 16:04:15,030 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduceSingleRegion' received 'reached' from coordinator. 2023-02-13 16:04:15,030 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,030 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:04:15,030 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-13 16:04:15,030 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-02-13 16:04:15,030 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-13 16:04:15,030 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38537,1676304253089' in zk 2023-02-13 16:04:15,030 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:15,030 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. started... 2023-02-13 16:04:15,030 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] regionserver.HRegion(2744): Flushing b8e7ae6faaaed9f3487d22335be948bf 2/2 column families, dataSize=1.01 MB heapSize=3.49 MB 2023-02-13 16:04:15,031 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-13 16:04:15,031 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:15,031 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-13 16:04:15,042 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/.tmp/f1/f9d8b0b3c00f44baa3013bfc7e396455 2023-02-13 16:04:15,059 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=514.92 KB at sequenceid=5 (bloomFilter=false), to=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/.tmp/f2/5ec1a742df194e9f9aef894263c208fd 2023-02-13 16:04:15,063 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/.tmp/f1/f9d8b0b3c00f44baa3013bfc7e396455 as hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/f9d8b0b3c00f44baa3013bfc7e396455 2023-02-13 16:04:15,066 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/f9d8b0b3c00f44baa3013bfc7e396455, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 16:04:15,066 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/.tmp/f2/5ec1a742df194e9f9aef894263c208fd as hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/5ec1a742df194e9f9aef894263c208fd 2023-02-13 16:04:15,069 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/5ec1a742df194e9f9aef894263c208fd, entries=17576, sequenceid=5, filesize=537.3 K 2023-02-13 16:04:15,070 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.01 MB/1054560, heapSize ~3.49 MB/3656288, currentSize=0 B/0 for b8e7ae6faaaed9f3487d22335be948bf in 40ms, sequenceid=5, compaction requested=false 2023-02-13 16:04:15,070 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for b8e7ae6faaaed9f3487d22335be948bf: 2023-02-13 16:04:15,070 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.' region-info for snapshot=testWithMapReduceSingleRegion 2023-02-13 16:04:15,070 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-13 16:04:15,070 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/f9d8b0b3c00f44baa3013bfc7e396455] hfiles 2023-02-13 16:04:15,070 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/f9d8b0b3c00f44baa3013bfc7e396455 for snapshot=testWithMapReduceSingleRegion 2023-02-13 16:04:15,070 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/5ec1a742df194e9f9aef894263c208fd] hfiles 2023-02-13 16:04:15,070 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/5ec1a742df194e9f9aef894263c208fd for snapshot=testWithMapReduceSingleRegion 2023-02-13 16:04:15,076 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. completed. 2023-02-13 16:04:15,076 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:15,076 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-02-13 16:04:15,076 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-02-13 16:04:15,076 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,076 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduceSingleRegion' locally completed 2023-02-13 16:04:15,076 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduceSingleRegion' completed for member 'jenkins-hbase4.apache.org,38947,1676304253061' in zk 2023-02-13 16:04:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduceSingleRegion' has notified controller of completion 2023-02-13 16:04:15,079 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:15,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:15,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:04:15,079 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduceSingleRegion' completed. 2023-02-13 16:04:15,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:15,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:15,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 16:04:15,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 16:04:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduceSingleRegion' member 'jenkins-hbase4.apache.org,38947,1676304253061': 2023-02-13 16:04:15,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38947,1676304253061' released barrier for procedure'testWithMapReduceSingleRegion', counting down latch. Waiting for 0 more 2023-02-13 16:04:15,082 INFO [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduceSingleRegion' execution completed 2023-02-13 16:04:15,082 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:04:15,082 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:04:15,082 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduceSingleRegion 2023-02-13 16:04:15,082 INFO [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceSingleRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-13 16:04:15,084 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,084 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,084 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-13 16:04:15,084 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,084 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,085 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:15,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:15,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:15,085 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 16:04:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:15,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 16:04:15,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,086 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,086 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduceSingleRegion 2023-02-13 16:04:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:15,095 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:15,095 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for testWithMapReduceSingleRegion 2023-02-13 16:04:15,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/testWithMapReduceSingleRegion 2023-02-13 16:04:15,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-13 16:04:15,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for testWithMapReduceSingleRegion 2023-02-13 16:04:15,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:15,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-13 16:04:15,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-13 16:04:15,095 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,096 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/testWithMapReduceSingleRegion 2023-02-13 16:04:15,096 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/testWithMapReduceSingleRegion 2023-02-13 16:04:15,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 16:04:15,106 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:04:15,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:04:15,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] snapshot.SnapshotManager(404): Snapshoting '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' is still in progress! 2023-02-13 16:04:15,107 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-13 16:04:15,111 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion to hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.hbase-snapshot/testWithMapReduceSingleRegion 2023-02-13 16:04:15,128 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed 2023-02-13 16:04:15,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 16:04:15,128 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.hbase-snapshot/.tmp/testWithMapReduceSingleRegion 2023-02-13 16:04:15,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot testWithMapReduceSingleRegion C_M_SNAPSHOT_TABLE on table testWithMapReduce at 1676304255003Consolidate snapshot: testWithMapReduceSingleRegion at 1676304255095 (+92 ms)Loading Region manifests for testWithMapReduceSingleRegion at 1676304255095Writing data manifest for testWithMapReduceSingleRegion at 1676304255098 (+3 ms)Verifying snapshot: testWithMapReduceSingleRegion at 1676304255105 (+7 ms)Snapshot testWithMapReduceSingleRegion of table testWithMapReduce completed at 1676304255128 (+23 ms) 2023-02-13 16:04:15,128 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=14, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED 2023-02-13 16:04:15,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testWithMapReduce, type=SHARED in 122 msec 2023-02-13 16:04:15,307 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-13 16:04:15,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 } is done 2023-02-13 16:04:15,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] snapshot.SnapshotManager(401): Snapshot '{ ss=testWithMapReduceSingleRegion table=testWithMapReduce type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-13 16:04:15,309 INFO [Listener at localhost/45519] snapshot.SnapshotTestingUtils(399): Confirming snapshot exists. 2023-02-13 16:04:15,312 INFO [Listener at localhost/45519] snapshot.SnapshotTestingUtils(406): validating snapshot. 2023-02-13 16:04:15,317 INFO [Listener at localhost/45519] mapreduce.TableSnapshotInputFormatTestBase(218): load different values 2023-02-13 16:04:15,346 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] regionserver.RSRpcServices(2655): Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 17576 Client: jenkins//172.31.14.131 first region in multi=testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:15,439 INFO [Listener at localhost/45519] mapreduce.TableSnapshotInputFormatTestBase(222): cause flush to create new files in the region 2023-02-13 16:04:15,444 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(933): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-02-13 16:04:15,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] procedure.ProcedureCoordinator(165): Submitting procedure testWithMapReduce 2023-02-13 16:04:15,446 INFO [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testWithMapReduce' 2023-02-13 16:04:15,446 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:04:15,446 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testWithMapReduce' starting 'acquire' 2023-02-13 16:04:15,446 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testWithMapReduce', kicking off acquire phase on members. 2023-02-13 16:04:15,446 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,446 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:04:15,448 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:15,448 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:15,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:15,448 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:15,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:15,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:15,448 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,448 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-13 16:04:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:04:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:04:15,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,449 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:04:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:04:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-13 16:04:15,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:04:15,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 16:04:15,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testWithMapReduce 2023-02-13 16:04:15,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 16:04:15,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testWithMapReduce 2023-02-13 16:04:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 16:04:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:04:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 16:04:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testWithMapReduce' with timeout 60000ms 2023-02-13 16:04:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-13 16:04:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 16:04:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testWithMapReduce' starting 'acquire' stage 2023-02-13 16:04:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38537,1676304253089' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 16:04:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-13 16:04:15,450 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-13 16:04:15,450 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:15,450 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. started... 2023-02-13 16:04:15,450 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing b8e7ae6faaaed9f3487d22335be948bf 2/2 column families, dataSize=1.58 MB heapSize=4.02 MB 2023-02-13 16:04:15,451 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,452 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,452 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:15,465 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/.tmp/f1/3e7bbadcd5cf4e289c83c23d86beadb7 2023-02-13 16:04:15,489 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=806.71 KB at sequenceid=9 (bloomFilter=false), to=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/.tmp/f2/758efa4ddfa54dcab2cf2d634f6a7edd 2023-02-13 16:04:15,493 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/.tmp/f1/3e7bbadcd5cf4e289c83c23d86beadb7 as hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/3e7bbadcd5cf4e289c83c23d86beadb7 2023-02-13 16:04:15,497 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/3e7bbadcd5cf4e289c83c23d86beadb7, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 16:04:15,497 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/.tmp/f2/758efa4ddfa54dcab2cf2d634f6a7edd as hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/758efa4ddfa54dcab2cf2d634f6a7edd 2023-02-13 16:04:15,501 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/758efa4ddfa54dcab2cf2d634f6a7edd, entries=17576, sequenceid=9, filesize=829.4 K 2023-02-13 16:04:15,502 INFO [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~1.58 MB/1652144, heapSize ~4.02 MB/4218720, currentSize=0 B/0 for b8e7ae6faaaed9f3487d22335be948bf in 52ms, sequenceid=9, compaction requested=false 2023-02-13 16:04:15,502 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for b8e7ae6faaaed9f3487d22335be948bf: 2023-02-13 16:04:15,502 DEBUG [rs(jenkins-hbase4.apache.org,38947,1676304253061)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:15,502 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-13 16:04:15,502 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-13 16:04:15,502 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,502 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testWithMapReduce' locally acquired 2023-02-13 16:04:15,502 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38947,1676304253061' joining acquired barrier for procedure (testWithMapReduce) in zk 2023-02-13 16:04:15,504 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,504 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:15,504 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,504 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testWithMapReduce' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-13 16:04:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:04:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:15,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38947,1676304253061' joining acquired barrier for procedure 'testWithMapReduce' on coordinator 2023-02-13 16:04:15,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ed959ae[Count = 0] remaining members to acquire global barrier 2023-02-13 16:04:15,506 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testWithMapReduce' starting 'in-barrier' execution. 2023-02-13 16:04:15,506 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,507 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,507 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,507 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,507 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 16:04:15,507 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 16:04:15,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,507 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38537,1676304253089' in zk 2023-02-13 16:04:15,507 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testWithMapReduce' received 'reached' from coordinator. 2023-02-13 16:04:15,507 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testWithMapReduce' locally completed 2023-02-13 16:04:15,507 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-13 16:04:15,507 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testWithMapReduce' completed for member 'jenkins-hbase4.apache.org,38947,1676304253061' in zk 2023-02-13 16:04:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 16:04:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,38537,1676304253089' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 16:04:15,511 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testWithMapReduce' has notified controller of completion 2023-02-13 16:04:15,511 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,511 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:15,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,511 DEBUG [member: 'jenkins-hbase4.apache.org,38947,1676304253061' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testWithMapReduce' completed. 2023-02-13 16:04:15,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:15,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:15,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:15,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:15,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:04:15,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:04:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testWithMapReduce' member 'jenkins-hbase4.apache.org,38947,1676304253061': 2023-02-13 16:04:15,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38947,1676304253061' released barrier for procedure'testWithMapReduce', counting down latch. Waiting for 0 more 2023-02-13 16:04:15,514 INFO [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testWithMapReduce' execution completed 2023-02-13 16:04:15,514 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-13 16:04:15,514 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-13 16:04:15,514 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testWithMapReduce 2023-02-13 16:04:15,514 INFO [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testWithMapReduceincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-13 16:04:15,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:15,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,515 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:15,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-13 16:04:15,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-13 16:04:15,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:15,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:15,516 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:15,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:15,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-13 16:04:15,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,516 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:04:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-13 16:04:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:04:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,518 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-13 16:04:15,518 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testWithMapReduce 2023-02-13 16:04:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:04:15,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:15,520 DEBUG [(jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-13 16:04:15,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testWithMapReduce 2023-02-13 16:04:15,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:15,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:15,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-13 16:04:15,520 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testWithMapReduce' 2023-02-13 16:04:15,520 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-13 16:04:15,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:15,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-13 16:04:15,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-13 16:04:15,520 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-13 16:04:15,521 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:15,521 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testWithMapReduce'' to complete. (max 20000 ms per retry) 2023-02-13 16:04:15,521 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testWithMapReduce 2023-02-13 16:04:15,521 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-13 16:04:15,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:15,521 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testWithMapReduce 2023-02-13 16:04:15,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-13 16:04:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-13 16:04:15,621 DEBUG [Listener at localhost/45519] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-13 16:04:15,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-13 16:04:15,708 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TestTableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/hadoop-153592682870640846.jar 2023-02-13 16:04:15,712 INFO [Listener at localhost/45519] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676304254993 type: FLUSH version: 2 ttl: 0 2023-02-13 16:04:15,712 DEBUG [Listener at localhost/45519] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41275/user/jenkins/test-data/e2743cf7-36fa-de62-b6ad-88aea5735fff/testWithMapReduceSingleRegion/9918af14-3dfe-46db-a90c-88539094a1e1/data/default/testWithMapReduce 2023-02-13 16:04:15,712 INFO [Listener at localhost/45519] snapshot.RestoreSnapshotHelper(239): region to add: b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:15,712 INFO [Listener at localhost/45519] snapshot.RestoreSnapshotHelper(585): clone region=b8e7ae6faaaed9f3487d22335be948bf as b8e7ae6faaaed9f3487d22335be948bf in snapshot testWithMapReduceSingleRegion 2023-02-13 16:04:15,713 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(7671): creating {ENCODED => b8e7ae6faaaed9f3487d22335be948bf, NAME => 'testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testWithMapReduce', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41275/user/jenkins/test-data/e2743cf7-36fa-de62-b6ad-88aea5735fff/testWithMapReduceSingleRegion/9918af14-3dfe-46db-a90c-88539094a1e1 2023-02-13 16:04:15,719 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:15,719 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink f9d8b0b3c00f44baa3013bfc7e396455 from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-13 16:04:15,721 INFO [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(628): Adding HFileLink 5ec1a742df194e9f9aef894263c208fd from cloned region in snapshot testWithMapReduceSingleRegion to table=testWithMapReduce 2023-02-13 16:04:15,722 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1603): Closing b8e7ae6faaaed9f3487d22335be948bf, disabling compactions & flushes 2023-02-13 16:04:15,722 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:15,722 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:15,722 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. after waiting 0 ms 2023-02-13 16:04:15,722 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:15,722 INFO [RestoreSnapshot-pool-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:15,723 DEBUG [RestoreSnapshot-pool-0] regionserver.HRegion(1557): Region close journal for b8e7ae6faaaed9f3487d22335be948bf: Waiting for close lock at 1676304255722Disabling compacts and flushes for region at 1676304255722Disabling writes for close at 1676304255722Writing region close event to WAL at 1676304255722Closed at 1676304255722 2023-02-13 16:04:15,723 INFO [Listener at localhost/45519] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "testWithMapReduceSingleRegion" table: "testWithMapReduce" creation_time: 1676304254993 type: FLUSH version: 2 ttl: 0 2023-02-13 16:04:15,723 DEBUG [Listener at localhost/45519] snapshot.RestoreSnapshotHelper(832): Restored table dir:hdfs://localhost:41275/user/jenkins/test-data/e2743cf7-36fa-de62-b6ad-88aea5735fff/testWithMapReduceSingleRegion/9918af14-3dfe-46db-a90c-88539094a1e1 2023-02-13 16:04:15,723 DEBUG [Listener at localhost/45519] util.CommonFSUtils(682): File system contents for path hdfs://localhost:41275/user/jenkins/test-data/e2743cf7-36fa-de62-b6ad-88aea5735fff/testWithMapReduceSingleRegion/9918af14-3dfe-46db-a90c-88539094a1e1 2023-02-13 16:04:15,723 DEBUG [Listener at localhost/45519] util.CommonFSUtils(699): |-data/ 2023-02-13 16:04:15,724 DEBUG [Listener at localhost/45519] util.CommonFSUtils(699): |----default/ 2023-02-13 16:04:15,724 DEBUG [Listener at localhost/45519] util.CommonFSUtils(699): |-------testWithMapReduce/ 2023-02-13 16:04:15,724 DEBUG [Listener at localhost/45519] util.CommonFSUtils(699): |----------b8e7ae6faaaed9f3487d22335be948bf/ 2023-02-13 16:04:15,725 DEBUG [Listener at localhost/45519] util.CommonFSUtils(702): |-------------.regioninfo 2023-02-13 16:04:15,725 DEBUG [Listener at localhost/45519] util.CommonFSUtils(699): |-------------f1/ 2023-02-13 16:04:15,725 DEBUG [Listener at localhost/45519] util.CommonFSUtils(702): |----------------testWithMapReduce=b8e7ae6faaaed9f3487d22335be948bf-f9d8b0b3c00f44baa3013bfc7e396455 2023-02-13 16:04:15,725 DEBUG [Listener at localhost/45519] util.CommonFSUtils(699): |-------------f2/ 2023-02-13 16:04:15,725 DEBUG [Listener at localhost/45519] util.CommonFSUtils(702): |----------------testWithMapReduce=b8e7ae6faaaed9f3487d22335be948bf-5ec1a742df194e9f9aef894263c208fd 2023-02-13 16:04:15,726 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:15,726 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:15,726 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:15,727 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:16,598 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/hadoop-4636752895367445098.jar 2023-02-13 16:04:16,598 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:16,599 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:16,664 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/hadoop-1951068990737375284.jar 2023-02-13 16:04:16,664 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:16,665 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:16,665 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:16,665 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:16,666 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:16,666 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:16,666 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-02-13 16:04:16,667 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-02-13 16:04:16,667 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-02-13 16:04:16,668 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-02-13 16:04:16,669 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-02-13 16:04:16,669 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-02-13 16:04:16,670 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-02-13 16:04:16,670 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-02-13 16:04:16,671 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-02-13 16:04:16,672 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-02-13 16:04:16,672 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.io.ImmutableBytesWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.17-SNAPSHOT.jar 2023-02-13 16:04:16,673 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.NullWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 16:04:16,674 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 16:04:16,674 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-02-13 16:04:16,675 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.lib.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 16:04:16,741 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapred.TableSnapshotInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/hadoop-7272879694492874156.jar 2023-02-13 16:04:16,742 DEBUG [Listener at localhost/45519] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapred.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-02-13 16:04:16,747 WARN [Listener at localhost/45519] mapreduce.JobResourceUploader(142): Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this. 2023-02-13 16:04:16,754 WARN [Listener at localhost/45519] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-02-13 16:04:16,761 INFO [Listener at localhost/45519] mapreduce.TableSnapshotInputFormatImpl(392): Provided Scan has DEFAULT ReadType, updating STREAM for Snapshot-based InputFormat 2023-02-13 16:04:16,840 WARN [Listener at localhost/45519] fs.FileUtil(850): Command 'ln -s /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/mapreduce.cluster.local.dir/1676304256806/libjars /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*' failed 1 with: ln: failed to create symbolic link '/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/*': No such file or directory 2023-02-13 16:04:16,841 WARN [Listener at localhost/45519] mapred.LocalDistributedCacheManager(202): Failed to create symlink: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/mapreduce.cluster.local.dir/1676304256806/libjars <- /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/libjars/* 2023-02-13 16:04:16,872 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(865): Instantiated testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-13 16:04:16,872 INFO [LocalJobRunner Map Task Executor #0] hfile.BlockCacheFactory(142): Allocating BlockCache size=32 MB, blockSize=64 KB 2023-02-13 16:04:16,872 DEBUG [LocalJobRunner Map Task Executor #0] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-13 16:04:16,874 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:16,874 DEBUG [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/e2743cf7-36fa-de62-b6ad-88aea5735fff/testWithMapReduceSingleRegion/9918af14-3dfe-46db-a90c-88539094a1e1/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1 2023-02-13 16:04:16,875 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8e7ae6faaaed9f3487d22335be948bf columnFamilyName f1 2023-02-13 16:04:16,922 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 16:04:16,922 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-13 16:04:16,927 DEBUG [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] regionserver.HStore(539): loaded hdfs://localhost:41275/user/jenkins/test-data/e2743cf7-36fa-de62-b6ad-88aea5735fff/testWithMapReduceSingleRegion/9918af14-3dfe-46db-a90c-88539094a1e1/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/testWithMapReduce=b8e7ae6faaaed9f3487d22335be948bf-f9d8b0b3c00f44baa3013bfc7e396455 2023-02-13 16:04:16,928 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] regionserver.HStore(310): Store=b8e7ae6faaaed9f3487d22335be948bf/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:16,928 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f2 of region b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:16,929 DEBUG [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41275/user/jenkins/test-data/e2743cf7-36fa-de62-b6ad-88aea5735fff/testWithMapReduceSingleRegion/9918af14-3dfe-46db-a90c-88539094a1e1/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2 2023-02-13 16:04:16,929 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8e7ae6faaaed9f3487d22335be948bf columnFamilyName f2 2023-02-13 16:04:16,933 DEBUG [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] regionserver.HStore(539): loaded hdfs://localhost:41275/user/jenkins/test-data/e2743cf7-36fa-de62-b6ad-88aea5735fff/testWithMapReduceSingleRegion/9918af14-3dfe-46db-a90c-88539094a1e1/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/testWithMapReduce=b8e7ae6faaaed9f3487d22335be948bf-5ec1a742df194e9f9aef894263c208fd 2023-02-13 16:04:16,933 INFO [StoreOpener-b8e7ae6faaaed9f3487d22335be948bf-1] regionserver.HStore(310): Store=b8e7ae6faaaed9f3487d22335be948bf/f2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-13 16:04:16,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testWithMapReduce descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-13 16:04:16,933 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1071): Opened b8e7ae6faaaed9f3487d22335be948bf; next sequenceid=6; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60514283, jitterRate=-0.09826691448688507}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-13 16:04:16,933 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(964): Region open journal for b8e7ae6faaaed9f3487d22335be948bf: Writing region info on filesystem at 1676304256872Initializing all the Stores at 1676304256873 (+1 ms)Instantiating store for column family {NAME => 'f1', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304256873Instantiating store for column family {NAME => 'f2', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676304256873Region opened successfully at 1676304256933 (+60 ms) 2023-02-13 16:04:17,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1603): Closing b8e7ae6faaaed9f3487d22335be948bf, disabling compactions & flushes 2023-02-13 16:04:17,011 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:17,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:17,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. after waiting 0 ms 2023-02-13 16:04:17,011 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:17,012 INFO [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:17,012 DEBUG [LocalJobRunner Map Task Executor #0] regionserver.HRegion(1557): Region close journal for b8e7ae6faaaed9f3487d22335be948bf: Waiting for close lock at 1676304257011Disabling compacts and flushes for region at 1676304257011Disabling writes for close at 1676304257011Writing region close event to WAL at 1676304257012 (+1 ms)Closed at 1676304257012 2023-02-13 16:04:17,875 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(748): Client=jenkins//172.31.14.131 delete name: "testWithMapReduceSingleRegion" 2023-02-13 16:04:17,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] snapshot.SnapshotManager(333): Deleting snapshot: testWithMapReduceSingleRegion 2023-02-13 16:04:17,878 INFO [Listener at localhost/45519] client.HBaseAdmin$15(890): Started disable of testWithMapReduce 2023-02-13 16:04:17,878 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.HMaster$11(2405): Client=jenkins//172.31.14.131 disable testWithMapReduce 2023-02-13 16:04:17,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] procedure2.ProcedureExecutor(1029): Stored pid=15, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testWithMapReduce 2023-02-13 16:04:17,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:04:17,881 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304257881"}]},"ts":"1676304257881"} 2023-02-13 16:04:17,882 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLING in hbase:meta 2023-02-13 16:04:17,884 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testWithMapReduce to state=DISABLING 2023-02-13 16:04:17,884 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b8e7ae6faaaed9f3487d22335be948bf, UNASSIGN}] 2023-02-13 16:04:17,885 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testWithMapReduce, region=b8e7ae6faaaed9f3487d22335be948bf, UNASSIGN 2023-02-13 16:04:17,886 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b8e7ae6faaaed9f3487d22335be948bf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:17,886 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676304257886"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1676304257886"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676304257886"}]},"ts":"1676304257886"} 2023-02-13 16:04:17,887 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; CloseRegionProcedure b8e7ae6faaaed9f3487d22335be948bf, server=jenkins-hbase4.apache.org,38947,1676304253061}] 2023-02-13 16:04:17,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:04:18,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(109): Close b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:18,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing b8e7ae6faaaed9f3487d22335be948bf, disabling compactions & flushes 2023-02-13 16:04:18,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:18,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:18,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. after waiting 0 ms 2023-02-13 16:04:18,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:18,043 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=1 2023-02-13 16:04:18,044 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf. 2023-02-13 16:04:18,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for b8e7ae6faaaed9f3487d22335be948bf: Waiting for close lock at 1676304258039Running coprocessor pre-close hooks at 1676304258039Disabling compacts and flushes for region at 1676304258039Disabling writes for close at 1676304258039Writing region close event to WAL at 1676304258040 (+1 ms)Running coprocessor post-close hooks at 1676304258043 (+3 ms)Closed at 1676304258044 (+1 ms) 2023-02-13 16:04:18,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(147): Closed b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:18,046 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=b8e7ae6faaaed9f3487d22335be948bf, regionState=CLOSED 2023-02-13 16:04:18,046 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.","families":{"info":[{"qualifier":"regioninfo","vlen":51,"tag":[],"timestamp":"1676304258046"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676304258046"}]},"ts":"1676304258046"} 2023-02-13 16:04:18,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=16 2023-02-13 16:04:18,049 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=16, state=SUCCESS; CloseRegionProcedure b8e7ae6faaaed9f3487d22335be948bf, server=jenkins-hbase4.apache.org,38947,1676304253061 in 160 msec 2023-02-13 16:04:18,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-13 16:04:18,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=testWithMapReduce, region=b8e7ae6faaaed9f3487d22335be948bf, UNASSIGN in 165 msec 2023-02-13 16:04:18,050 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676304258050"}]},"ts":"1676304258050"} 2023-02-13 16:04:18,051 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testWithMapReduce, state=DISABLED in hbase:meta 2023-02-13 16:04:18,052 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testWithMapReduce to state=DISABLED 2023-02-13 16:04:18,054 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, state=SUCCESS; DisableTableProcedure table=testWithMapReduce in 175 msec 2023-02-13 16:04:18,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1227): Checking to see if procedure is done pid=15 2023-02-13 16:04:18,184 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testWithMapReduce, procId: 15 completed 2023-02-13 16:04:18,184 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.HMaster$5(2215): Client=jenkins//172.31.14.131 delete testWithMapReduce 2023-02-13 16:04:18,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:04:18,187 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=18, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:04:18,187 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=18, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:04:18,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 16:04:18,190 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:18,192 DEBUG [HFileArchiver-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1, FileablePath, hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2, FileablePath, hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/recovered.edits] 2023-02-13 16:04:18,194 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/3e7bbadcd5cf4e289c83c23d86beadb7 to hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/archive/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/3e7bbadcd5cf4e289c83c23d86beadb7 2023-02-13 16:04:18,195 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/f9d8b0b3c00f44baa3013bfc7e396455 to hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/archive/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f1/f9d8b0b3c00f44baa3013bfc7e396455 2023-02-13 16:04:18,198 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/5ec1a742df194e9f9aef894263c208fd to hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/archive/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/5ec1a742df194e9f9aef894263c208fd 2023-02-13 16:04:18,198 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/758efa4ddfa54dcab2cf2d634f6a7edd to hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/archive/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/f2/758efa4ddfa54dcab2cf2d634f6a7edd 2023-02-13 16:04:18,200 DEBUG [HFileArchiver-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/recovered.edits/12.seqid to hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/archive/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf/recovered.edits/12.seqid 2023-02-13 16:04:18,201 DEBUG [HFileArchiver-2] backup.HFileArchiver(596): Deleted hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/.tmp/data/default/testWithMapReduce/b8e7ae6faaaed9f3487d22335be948bf 2023-02-13 16:04:18,201 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testWithMapReduce regions 2023-02-13 16:04:18,203 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=18, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:04:18,205 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testWithMapReduce from hbase:meta 2023-02-13 16:04:18,206 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testWithMapReduce' descriptor. 2023-02-13 16:04:18,207 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=18, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:04:18,207 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testWithMapReduce' from region states. 2023-02-13 16:04:18,208 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676304258207"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:18,209 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-13 16:04:18,209 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b8e7ae6faaaed9f3487d22335be948bf, NAME => 'testWithMapReduce,,1676304254216.b8e7ae6faaaed9f3487d22335be948bf.', STARTKEY => '', ENDKEY => ''}] 2023-02-13 16:04:18,209 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testWithMapReduce' as deleted. 2023-02-13 16:04:18,209 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testWithMapReduce","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676304258209"}]},"ts":"9223372036854775807"} 2023-02-13 16:04:18,210 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testWithMapReduce state from META 2023-02-13 16:04:18,212 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=18, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testWithMapReduce 2023-02-13 16:04:18,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; DeleteTableProcedure table=testWithMapReduce in 27 msec 2023-02-13 16:04:18,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33331] master.MasterRpcServices(1227): Checking to see if procedure is done pid=18 2023-02-13 16:04:18,289 INFO [Listener at localhost/45519] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testWithMapReduce, procId: 18 completed 2023-02-13 16:04:18,289 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-13 16:04:18,289 INFO [Listener at localhost/45519] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-13 16:04:18,290 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74a4015e to 127.0.0.1:55214 2023-02-13 16:04:18,290 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:18,290 DEBUG [Listener at localhost/45519] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-13 16:04:18,290 DEBUG [Listener at localhost/45519] util.JVMClusterUtil(257): Found active master hash=1980885993, stopped=false 2023-02-13 16:04:18,290 INFO [Listener at localhost/45519] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33331,1676304253008 2023-02-13 16:04:18,292 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:18,292 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:18,292 INFO [Listener at localhost/45519] procedure2.ProcedureExecutor(629): Stopping 2023-02-13 16:04:18,292 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-13 16:04:18,292 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:18,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:18,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:18,294 DEBUG [Listener at localhost/45519] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3064629f to 127.0.0.1:55214 2023-02-13 16:04:18,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-13 16:04:18,294 DEBUG [Listener at localhost/45519] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:18,295 INFO [Listener at localhost/45519] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38947,1676304253061' ***** 2023-02-13 16:04:18,295 INFO [Listener at localhost/45519] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:04:18,295 INFO [Listener at localhost/45519] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,38537,1676304253089' ***** 2023-02-13 16:04:18,295 INFO [Listener at localhost/45519] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-13 16:04:18,295 INFO [RS:1;jenkins-hbase4:38537] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:04:18,295 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:04:18,295 INFO [RS:1;jenkins-hbase4:38537] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:04:18,296 INFO [RS:1;jenkins-hbase4:38537] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:04:18,296 INFO [RS:0;jenkins-hbase4:38947] regionserver.HeapMemoryManager(220): Stopping 2023-02-13 16:04:18,296 INFO [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(3304): Received CLOSE for 18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:18,297 INFO [RS:0;jenkins-hbase4:38947] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-13 16:04:18,297 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-13 16:04:18,297 INFO [RS:0;jenkins-hbase4:38947] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-13 16:04:18,297 INFO [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:18,298 INFO [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:18,298 DEBUG [RS:1;jenkins-hbase4:38537] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c765b59 to 127.0.0.1:55214 2023-02-13 16:04:18,298 DEBUG [RS:0;jenkins-hbase4:38947] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ad5c52b to 127.0.0.1:55214 2023-02-13 16:04:18,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 18a8724af1e2eef2d70399439d08488b, disabling compactions & flushes 2023-02-13 16:04:18,298 DEBUG [RS:0;jenkins-hbase4:38947] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:18,298 DEBUG [RS:1;jenkins-hbase4:38537] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:18,298 INFO [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38947,1676304253061; all regions closed. 2023-02-13 16:04:18,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:18,298 INFO [RS:1;jenkins-hbase4:38537] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:04:18,298 INFO [RS:1;jenkins-hbase4:38537] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:04:18,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:18,298 INFO [RS:1;jenkins-hbase4:38537] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:04:18,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. after waiting 0 ms 2023-02-13 16:04:18,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:18,298 INFO [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-13 16:04:18,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 18a8724af1e2eef2d70399439d08488b 1/1 column families, dataSize=78 B heapSize=488 B 2023-02-13 16:04:18,298 INFO [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1475): Waiting on 2 regions to close 2023-02-13 16:04:18,299 DEBUG [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1479): Online Regions={1588230740=hbase:meta,,1.1588230740, 18a8724af1e2eef2d70399439d08488b=hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b.} 2023-02-13 16:04:18,299 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-13 16:04:18,299 DEBUG [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1505): Waiting on 1588230740, 18a8724af1e2eef2d70399439d08488b 2023-02-13 16:04:18,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-13 16:04:18,299 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-13 16:04:18,299 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-13 16:04:18,299 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-13 16:04:18,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=3.70 KB heapSize=7.12 KB 2023-02-13 16:04:18,302 DEBUG [RS:0;jenkins-hbase4:38947] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/oldWALs 2023-02-13 16:04:18,302 INFO [RS:0;jenkins-hbase4:38947] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38947%2C1676304253061:(num 1676304254403) 2023-02-13 16:04:18,302 DEBUG [RS:0;jenkins-hbase4:38947] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:18,302 INFO [RS:0;jenkins-hbase4:38947] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:18,302 INFO [RS:0;jenkins-hbase4:38947] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 16:04:18,302 INFO [RS:0;jenkins-hbase4:38947] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-13 16:04:18,303 INFO [RS:0;jenkins-hbase4:38947] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-13 16:04:18,303 INFO [RS:0;jenkins-hbase4:38947] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-13 16:04:18,303 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:18,304 INFO [RS:0;jenkins-hbase4:38947] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38947 2023-02-13 16:04:18,305 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:18,305 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38947,1676304253061 2023-02-13 16:04:18,305 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:18,305 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:18,305 ERROR [Listener at localhost/45519-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2ccce5f1 rejected from java.util.concurrent.ThreadPoolExecutor@28f374b0[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:18,306 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:18,306 ERROR [Listener at localhost/45519-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@177e18ab rejected from java.util.concurrent.ThreadPoolExecutor@28f374b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:18,306 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38947,1676304253061] 2023-02-13 16:04:18,306 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38947,1676304253061; numProcessing=1 2023-02-13 16:04:18,307 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38947,1676304253061 already deleted, retry=false 2023-02-13 16:04:18,307 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38947,1676304253061 expired; onlineServers=1 2023-02-13 16:04:18,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b/.tmp/info/04c2d7fbd7a24ffab8b0107df688304d 2023-02-13 16:04:18,309 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/.tmp/info/8027a1c3a7d3428d887c97303a729fa3 2023-02-13 16:04:18,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8027a1c3a7d3428d887c97303a729fa3 2023-02-13 16:04:18,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b/.tmp/info/04c2d7fbd7a24ffab8b0107df688304d as hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b/info/04c2d7fbd7a24ffab8b0107df688304d 2023-02-13 16:04:18,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b/info/04c2d7fbd7a24ffab8b0107df688304d, entries=2, sequenceid=6, filesize=4.8 K 2023-02-13 16:04:18,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 18a8724af1e2eef2d70399439d08488b in 20ms, sequenceid=6, compaction requested=false 2023-02-13 16:04:18,321 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=97 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/.tmp/rep_barrier/f0fe95971b9d44d78534f83461c76f65 2023-02-13 16:04:18,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/namespace/18a8724af1e2eef2d70399439d08488b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-02-13 16:04:18,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:18,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 18a8724af1e2eef2d70399439d08488b: Waiting for close lock at 1676304258298Running coprocessor pre-close hooks at 1676304258298Disabling compacts and flushes for region at 1676304258298Disabling writes for close at 1676304258298Obtaining lock to block concurrent updates at 1676304258298Preparing flush snapshotting stores in 18a8724af1e2eef2d70399439d08488b at 1676304258298Finished memstore snapshotting hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b., syncing WAL and waiting on mvcc, flushsize=dataSize=78, getHeapSize=472, getOffHeapSize=0, getCellsCount=2 at 1676304258299 (+1 ms)Flushing stores of hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. at 1676304258299Flushing 18a8724af1e2eef2d70399439d08488b/info: creating writer at 1676304258299Flushing 18a8724af1e2eef2d70399439d08488b/info: appending metadata at 1676304258302 (+3 ms)Flushing 18a8724af1e2eef2d70399439d08488b/info: closing flushed file at 1676304258302Flushing 18a8724af1e2eef2d70399439d08488b/info: reopening flushed file at 1676304258314 (+12 ms)Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 18a8724af1e2eef2d70399439d08488b in 20ms, sequenceid=6, compaction requested=false at 1676304258318 (+4 ms)Writing region close event to WAL at 1676304258319 (+1 ms)Running coprocessor post-close hooks at 1676304258322 (+3 ms)Closed at 1676304258323 (+1 ms) 2023-02-13 16:04:18,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676304253630.18a8724af1e2eef2d70399439d08488b. 2023-02-13 16:04:18,325 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0fe95971b9d44d78534f83461c76f65 2023-02-13 16:04:18,331 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=428 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/.tmp/table/73c2f4e101e84e4b99de0e2f3aaa1f10 2023-02-13 16:04:18,334 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73c2f4e101e84e4b99de0e2f3aaa1f10 2023-02-13 16:04:18,334 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/.tmp/info/8027a1c3a7d3428d887c97303a729fa3 as hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/info/8027a1c3a7d3428d887c97303a729fa3 2023-02-13 16:04:18,338 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8027a1c3a7d3428d887c97303a729fa3 2023-02-13 16:04:18,338 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/info/8027a1c3a7d3428d887c97303a729fa3, entries=12, sequenceid=21, filesize=6.2 K 2023-02-13 16:04:18,338 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/.tmp/rep_barrier/f0fe95971b9d44d78534f83461c76f65 as hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/rep_barrier/f0fe95971b9d44d78534f83461c76f65 2023-02-13 16:04:18,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0fe95971b9d44d78534f83461c76f65 2023-02-13 16:04:18,342 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/rep_barrier/f0fe95971b9d44d78534f83461c76f65, entries=1, sequenceid=21, filesize=5.0 K 2023-02-13 16:04:18,342 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/.tmp/table/73c2f4e101e84e4b99de0e2f3aaa1f10 as hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/table/73c2f4e101e84e4b99de0e2f3aaa1f10 2023-02-13 16:04:18,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73c2f4e101e84e4b99de0e2f3aaa1f10 2023-02-13 16:04:18,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/table/73c2f4e101e84e4b99de0e2f3aaa1f10, entries=4, sequenceid=21, filesize=5.0 K 2023-02-13 16:04:18,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 46ms, sequenceid=21, compaction requested=false 2023-02-13 16:04:18,348 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/data/hbase/meta/1588230740/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2023-02-13 16:04:18,349 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-13 16:04:18,350 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:18,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676304258299Running coprocessor pre-close hooks at 1676304258299Disabling compacts and flushes for region at 1676304258299Disabling writes for close at 1676304258299Obtaining lock to block concurrent updates at 1676304258299Preparing flush snapshotting stores in 1588230740 at 1676304258299Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=3789, getHeapSize=7240, getOffHeapSize=0, getCellsCount=36 at 1676304258299Flushing stores of hbase:meta,,1.1588230740 at 1676304258300 (+1 ms)Flushing 1588230740/info: creating writer at 1676304258300Flushing 1588230740/info: appending metadata at 1676304258302 (+2 ms)Flushing 1588230740/info: closing flushed file at 1676304258302Flushing 1588230740/rep_barrier: creating writer at 1676304258313 (+11 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676304258315 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676304258315Flushing 1588230740/table: creating writer at 1676304258325 (+10 ms)Flushing 1588230740/table: appending metadata at 1676304258326 (+1 ms)Flushing 1588230740/table: closing flushed file at 1676304258326Flushing 1588230740/info: reopening flushed file at 1676304258335 (+9 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676304258339 (+4 ms)Flushing 1588230740/table: reopening flushed file at 1676304258342 (+3 ms)Finished flush of dataSize ~3.70 KB/3789, heapSize ~7.07 KB/7240, currentSize=0 B/0 for 1588230740 in 46ms, sequenceid=21, compaction requested=false at 1676304258346 (+4 ms)Writing region close event to WAL at 1676304258346Running coprocessor post-close hooks at 1676304258349 (+3 ms)Closed at 1676304258350 (+1 ms) 2023-02-13 16:04:18,350 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-13 16:04:18,368 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:18,376 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:18,392 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-13 16:04:18,392 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-13 16:04:18,492 INFO [RS:0;jenkins-hbase4:38947] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38947,1676304253061; zookeeper connection closed. 2023-02-13 16:04:18,492 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:18,492 ERROR [Listener at localhost/45519-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6f332d16 rejected from java.util.concurrent.ThreadPoolExecutor@28f374b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:18,492 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x1004e6cea030001, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:18,492 ERROR [Listener at localhost/45519-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6a02ead5 rejected from java.util.concurrent.ThreadPoolExecutor@28f374b0[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 16] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:18,493 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@422c3bc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@422c3bc 2023-02-13 16:04:18,499 INFO [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,38537,1676304253089; all regions closed. 2023-02-13 16:04:18,506 DEBUG [RS:1;jenkins-hbase4:38537] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/oldWALs 2023-02-13 16:04:18,506 INFO [RS:1;jenkins-hbase4:38537] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38537%2C1676304253089.meta:.meta(num 1676304253577) 2023-02-13 16:04:18,510 DEBUG [RS:1;jenkins-hbase4:38537] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/oldWALs 2023-02-13 16:04:18,510 INFO [RS:1;jenkins-hbase4:38537] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38537%2C1676304253089:(num 1676304254001) 2023-02-13 16:04:18,510 DEBUG [RS:1;jenkins-hbase4:38537] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:18,510 INFO [RS:1;jenkins-hbase4:38537] regionserver.LeaseManager(133): Closed leases 2023-02-13 16:04:18,510 INFO [RS:1;jenkins-hbase4:38537] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-13 16:04:18,510 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:18,513 INFO [RS:1;jenkins-hbase4:38537] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38537 2023-02-13 16:04:18,514 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-13 16:04:18,514 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38537,1676304253089 2023-02-13 16:04:18,514 ERROR [Listener at localhost/45519-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5c5c3f09 rejected from java.util.concurrent.ThreadPoolExecutor@5863a05a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:18,515 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38537,1676304253089] 2023-02-13 16:04:18,515 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38537,1676304253089; numProcessing=2 2023-02-13 16:04:18,516 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38537,1676304253089 already deleted, retry=false 2023-02-13 16:04:18,516 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38537,1676304253089 expired; onlineServers=0 2023-02-13 16:04:18,516 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase4.apache.org,33331,1676304253008' ***** 2023-02-13 16:04:18,516 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-13 16:04:18,517 DEBUG [M:0;jenkins-hbase4:33331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@722e61f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-02-13 16:04:18,517 INFO [M:0;jenkins-hbase4:33331] regionserver.HRegionServer(1145): stopping server jenkins-hbase4.apache.org,33331,1676304253008 2023-02-13 16:04:18,517 INFO [M:0;jenkins-hbase4:33331] regionserver.HRegionServer(1171): stopping server jenkins-hbase4.apache.org,33331,1676304253008; all regions closed. 2023-02-13 16:04:18,517 DEBUG [M:0;jenkins-hbase4:33331] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-13 16:04:18,517 DEBUG [M:0;jenkins-hbase4:33331] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-13 16:04:18,517 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-13 16:04:18,517 DEBUG [M:0;jenkins-hbase4:33331] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-13 16:04:18,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304253226] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1676304253226,5,FailOnTimeoutGroup] 2023-02-13 16:04:18,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304253226] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1676304253226,5,FailOnTimeoutGroup] 2023-02-13 16:04:18,518 INFO [M:0;jenkins-hbase4:33331] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-13 16:04:18,519 INFO [M:0;jenkins-hbase4:33331] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-13 16:04:18,519 INFO [M:0;jenkins-hbase4:33331] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-02-13 16:04:18,519 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-13 16:04:18,519 DEBUG [M:0;jenkins-hbase4:33331] master.HMaster(1502): Stopping service threads 2023-02-13 16:04:18,519 INFO [M:0;jenkins-hbase4:33331] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-13 16:04:18,519 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-13 16:04:18,519 ERROR [M:0;jenkins-hbase4:33331] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2023-02-13 16:04:18,519 INFO [M:0;jenkins-hbase4:33331] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-13 16:04:18,520 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-13 16:04:18,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-13 16:04:18,521 DEBUG [M:0;jenkins-hbase4:33331] zookeeper.ZKUtil(398): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-13 16:04:18,521 WARN [M:0;jenkins-hbase4:33331] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-13 16:04:18,521 INFO [M:0;jenkins-hbase4:33331] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-13 16:04:18,522 INFO [M:0;jenkins-hbase4:33331] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-13 16:04:18,522 DEBUG [M:0;jenkins-hbase4:33331] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-13 16:04:18,522 INFO [M:0;jenkins-hbase4:33331] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:18,522 DEBUG [M:0;jenkins-hbase4:33331] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:18,522 DEBUG [M:0;jenkins-hbase4:33331] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-13 16:04:18,522 DEBUG [M:0;jenkins-hbase4:33331] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:18,522 INFO [M:0;jenkins-hbase4:33331] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=54.68 KB heapSize=65.64 KB 2023-02-13 16:04:18,534 INFO [M:0;jenkins-hbase4:33331] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=54.68 KB at sequenceid=132 (bloomFilter=true), to=hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0d907f78c70a4fceaa26443235e179b9 2023-02-13 16:04:18,539 DEBUG [M:0;jenkins-hbase4:33331] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/0d907f78c70a4fceaa26443235e179b9 as hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0d907f78c70a4fceaa26443235e179b9 2023-02-13 16:04:18,544 INFO [M:0;jenkins-hbase4:33331] regionserver.HStore(1080): Added hdfs://localhost:41275/user/jenkins/test-data/884514c7-fa0a-6db7-64fb-7647c909a3c7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/0d907f78c70a4fceaa26443235e179b9, entries=17, sequenceid=132, filesize=8.6 K 2023-02-13 16:04:18,545 INFO [M:0;jenkins-hbase4:33331] regionserver.HRegion(2947): Finished flush of dataSize ~54.68 KB/55995, heapSize ~65.63 KB/67200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=132, compaction requested=false 2023-02-13 16:04:18,545 INFO [M:0;jenkins-hbase4:33331] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-13 16:04:18,545 DEBUG [M:0;jenkins-hbase4:33331] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676304258522Disabling compacts and flushes for region at 1676304258522Disabling writes for close at 1676304258522Obtaining lock to block concurrent updates at 1676304258522Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676304258522Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=55995, getHeapSize=67200, getOffHeapSize=0, getCellsCount=145 at 1676304258522Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676304258523 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676304258523Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676304258526 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676304258526Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676304258540 (+14 ms)Finished flush of dataSize ~54.68 KB/55995, heapSize ~65.63 KB/67200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 23ms, sequenceid=132, compaction requested=false at 1676304258545 (+5 ms)Writing region close event to WAL at 1676304258545Closed at 1676304258545 2023-02-13 16:04:18,549 INFO [M:0;jenkins-hbase4:33331] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-13 16:04:18,549 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-13 16:04:18,549 INFO [M:0;jenkins-hbase4:33331] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33331 2023-02-13 16:04:18,551 DEBUG [M:0;jenkins-hbase4:33331] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33331,1676304253008 already deleted, retry=false 2023-02-13 16:04:18,654 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:18,654 INFO [M:0;jenkins-hbase4:33331] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,33331,1676304253008; zookeeper connection closed. 2023-02-13 16:04:18,654 ERROR [Listener at localhost/45519-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4c7f5193 rejected from java.util.concurrent.ThreadPoolExecutor@4840ccc4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:18,655 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): master:33331-0x1004e6cea030000, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:18,655 ERROR [Listener at localhost/45519-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@a40c8b3 rejected from java.util.concurrent.ThreadPoolExecutor@4840ccc4[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 51] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:18,893 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:18,893 INFO [RS:1;jenkins-hbase4:38537] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase4.apache.org,38537,1676304253089; zookeeper connection closed. 2023-02-13 16:04:18,893 ERROR [Listener at localhost/45519-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@112f7f2f rejected from java.util.concurrent.ThreadPoolExecutor@5863a05a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:18,894 DEBUG [Listener at localhost/45519-EventThread] zookeeper.ZKWatcher(600): regionserver:38537-0x1004e6cea030002, quorum=127.0.0.1:55214, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-13 16:04:18,894 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@49f3ba97] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@49f3ba97 2023-02-13 16:04:18,894 ERROR [Listener at localhost/45519-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6912bac8 rejected from java.util.concurrent.ThreadPoolExecutor@5863a05a[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 18] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-13 16:04:18,894 INFO [Listener at localhost/45519] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2023-02-13 16:04:18,894 WARN [Listener at localhost/45519] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:04:18,903 INFO [Listener at localhost/45519] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:18,976 WARN [BP-1117151997-172.31.14.131-1676304252305 heartbeating to localhost/127.0.0.1:41275] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1117151997-172.31.14.131-1676304252305 (Datanode Uuid 64f29041-0600-4422-b486-4b753b1f21d9) service to localhost/127.0.0.1:41275 2023-02-13 16:04:18,977 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/cluster_8ee46be2-6a6f-fcaf-f8fb-3bd93b162208/dfs/data/data3/current/BP-1117151997-172.31.14.131-1676304252305] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:18,977 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/cluster_8ee46be2-6a6f-fcaf-f8fb-3bd93b162208/dfs/data/data4/current/BP-1117151997-172.31.14.131-1676304252305] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:19,018 WARN [Listener at localhost/45519] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-13 16:04:19,058 INFO [Listener at localhost/45519] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:19,162 WARN [BP-1117151997-172.31.14.131-1676304252305 heartbeating to localhost/127.0.0.1:41275] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-13 16:04:19,162 WARN [BP-1117151997-172.31.14.131-1676304252305 heartbeating to localhost/127.0.0.1:41275] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1117151997-172.31.14.131-1676304252305 (Datanode Uuid c4e46b26-9be0-489f-b659-b336e2f2177b) service to localhost/127.0.0.1:41275 2023-02-13 16:04:19,162 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/cluster_8ee46be2-6a6f-fcaf-f8fb-3bd93b162208/dfs/data/data1/current/BP-1117151997-172.31.14.131-1676304252305] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:19,163 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8da3aca3-856c-0b2f-5ab6-1b124afb511b/cluster_8ee46be2-6a6f-fcaf-f8fb-3bd93b162208/dfs/data/data2/current/BP-1117151997-172.31.14.131-1676304252305] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-13 16:04:19,177 INFO [Listener at localhost/45519] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-13 16:04:19,295 INFO [Listener at localhost/45519] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-13 16:04:19,318 INFO [Listener at localhost/45519] hbase.HBaseTestingUtility(1293): Minicluster is down 2023-02-13 16:04:19,340 INFO [Listener at localhost/45519] hbase.ResourceChecker(175): after: mapred.TestTableSnapshotInputFormat#testWithMapReduceSingleRegion Thread=295 (was 277) Potentially hanging thread: (jenkins-hbase4.apache.org,33331,1676304253008)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:41275 from jenkins.hfs.12 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Listener at localhost/45519 java.lang.Thread.dumpThreads(Native Method) java.lang.Thread.getAllStackTraces(Thread.java:1615) org.apache.hadoop.hbase.ResourceCheckerJUnitListener$ThreadResourceAnalyzer.getVal(ResourceCheckerJUnitListener.java:49) org.apache.hadoop.hbase.ResourceChecker.fill(ResourceChecker.java:110) org.apache.hadoop.hbase.ResourceChecker.fillEndings(ResourceChecker.java:104) org.apache.hadoop.hbase.ResourceChecker.end(ResourceChecker.java:206) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.end(ResourceCheckerJUnitListener.java:165) org.apache.hadoop.hbase.ResourceCheckerJUnitListener.testFinished(ResourceCheckerJUnitListener.java:185) org.junit.runner.notification.SynchronizedRunListener.testFinished(SynchronizedRunListener.java:87) org.junit.runner.notification.RunNotifier$9.notifyListener(RunNotifier.java:225) org.junit.runner.notification.RunNotifier$SafeNotifier.run(RunNotifier.java:72) org.junit.runner.notification.RunNotifier.fireTestFinished(RunNotifier.java:222) org.junit.internal.runners.model.EachTestNotifier.fireTestFinished(EachTestNotifier.java:38) org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:372) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) org.apache.hadoop.hbase.SystemExitRule$1.evaluate(SystemExitRule.java:39) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-21-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-1 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-28-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-23-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins@localhost:41275 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-22-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:41275 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LeaseRenewer:jenkins.hfs.13@localhost:41275 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:41275 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: nioEventLoopGroup-27-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LeaseRenewer:jenkins.hfs.12@localhost:41275 java.lang.Thread.sleep(Native Method) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.run(LeaseRenewer.java:411) org.apache.hadoop.hdfs.client.impl.LeaseRenewer.access$600(LeaseRenewer.java:76) org.apache.hadoop.hdfs.client.impl.LeaseRenewer$1.run(LeaseRenewer.java:307) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-26-2 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-27-1 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: nioEventLoopGroup-29-3 java.lang.Thread.sleep(Native Method) io.netty.util.concurrent.SingleThreadEventExecutor.confirmShutdown(SingleThreadEventExecutor.java:790) io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:525) io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (562895999) connection to localhost/127.0.0.1:41275 from jenkins.hfs.13 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-23-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=598 (was 581) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=303 (was 320), ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=1115 (was 1408)